Jul 22 21:03:39.902133 ip-10-0-142-246 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 21:03:39.902153 ip-10-0-142-246 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 21:03:39.902162 ip-10-0-142-246 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 21:03:39.902478 ip-10-0-142-246 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 21:03:48.909797 ip-10-0-142-246 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 21:03:48.909810 ip-10-0-142-246 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bd8569432f7f46558cf840f0b81b26da --
Jul 22 21:05:38.539414 ip-10-0-142-246 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 21:05:38.954074 ip-10-0-142-246 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:38.954074 ip-10-0-142-246 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 21:05:38.954074 ip-10-0-142-246 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:38.954074 ip-10-0-142-246 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 21:05:38.954074 ip-10-0-142-246 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:38.955165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.955073    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 21:05:38.960203 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960187    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.960203 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960204    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960207    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960211    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960214    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960218    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960221    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960223    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960227    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960229    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960232    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960235    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960241    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960243    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960246    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960249    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960252    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960254    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960257    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960259    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960262    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.960268 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960265    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960267    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960270    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960272    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960275    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960278    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960280    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960284    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960286    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960289    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960291    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960293    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960296    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960298    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960301    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960311    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960315    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960318    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960321    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.960771 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960323    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960326    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960329    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960331    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960335    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960339    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960342    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960344    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960347    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960350    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960352    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960355    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960357    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960360    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960362    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960365    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960368    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960371    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960374    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960376    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.961244 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960379    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960381    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960384    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960386    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960389    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960391    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960393    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960396    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960398    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960401    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960403    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960407    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960411    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960413    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960415    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960418    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960420    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960422    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960426    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.961728 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960429    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960433    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960436    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960438    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960441    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960444    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960447    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960451    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960453    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960456    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960458    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960461    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960463    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960466    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960468    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960471    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960473    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960476    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960478    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.960481    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.962198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961170    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961177    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961180    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961183    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961185    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961188    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961191    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961194    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961196    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961199    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961202    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961205    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961208    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961210    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961213    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961215    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961218    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961220    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961223    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.962708 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961226    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961228    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961231    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961233    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961236    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961238    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961240    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961243    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961248    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961252    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961256    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961259    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961261    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961264    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961267    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961270    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961273    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961275    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961278    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961280    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.963198 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961282    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961285    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961288    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961290    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961293    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961295    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961298    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961301    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961304    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961306    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961308    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961311    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961313    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961316    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961318    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961321    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961323    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961326    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961328    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961331    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.963782 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961333    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961336    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961338    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961340    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961343    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961345    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961348    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961350    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961353    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961355    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961358    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961360    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961362    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961366    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961368    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961370    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961374    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961376    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961379    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.964584 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961382    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961386    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961389    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961392    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961395    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961398    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961400    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961403    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961406    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961408    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961411    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961413    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961416    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961419    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961421    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961424    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961426    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961429    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961432    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.965207 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961435    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961440    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961769    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961774    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961776    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961779    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961782    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961784    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961787    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961790    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961792    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961796    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961798    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961801    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961805    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961807    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961811    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961815    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961818    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961821    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.965681 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961824    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961827    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961829    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961832    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961834    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961836    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961839    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961841    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961843    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961846    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961848    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961850    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961853    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961859    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961862    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961865    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961868    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961871    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961874    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.966195 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961877    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961879    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961882    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961885    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961887    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961890    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961893    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961896    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961898    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961900    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961903    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961906    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961908    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961911    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961913    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961915    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961918    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961920    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961923    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961925    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.966647 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961928    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961930    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961933    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961935    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961938    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961940    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961944    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961946    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961949    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961951    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961953    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961955    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961958    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961960    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961962    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961967    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961971    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961974    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961976    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.967155 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961979    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961982    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961984    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961987    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961989    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961991    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961994    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961997    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.961999    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962001    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962004    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962006    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962009    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962011    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962013    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962016    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962018    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962020    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962023    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962027    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.967735 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962029    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962031    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962034    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962118    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962143    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962153    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962158    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962163    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962166    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962170    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962173    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962176    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962179    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962182    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962186    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962189    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962192    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962194    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962197    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962200    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962202    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962206    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962209    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962212    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 21:05:38.968349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962215    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962218    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962221    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962223    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962226    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962229    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962232    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962236    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962239    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962242    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962245    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962249    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962251    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962254    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962258    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962261    2569 flags.go:64] FLAG: --enable-server="true"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962263    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962268    2569 flags.go:64] FLAG: --event-burst="100"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962271    2569 flags.go:64] FLAG: --event-qps="50"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962273    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962276    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962279    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962282    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962285    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962288    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 21:05:38.968924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962291    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962294    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962296    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962299    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962302    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962304    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962307    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962310    2569 flags.go:64] FLAG: --feature-gates=""
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962313    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962316    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962319    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962321    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962324    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962327    2569 flags.go:64] FLAG: --help="false"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962331    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-142-246.ec2.internal"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962334    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962337    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962340    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962343    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962346    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962349    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962354    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962356    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 21:05:38.969631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962359    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962362    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962365    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962368    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962371    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962373    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962376    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962378    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962382    2569 flags.go:64] FLAG: --lock-file=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962384    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962387    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962390    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962395    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962397    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962400    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962402    2569 flags.go:64] FLAG: --logging-format="text"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962405    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962408    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962411    2569 flags.go:64] FLAG: --manifest-url=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962413    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962417    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962420    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962424    2569 flags.go:64] FLAG: --max-pods="110"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962428    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962431    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 21:05:38.970298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962434    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962436    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962439    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962442    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962444    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962454    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962456    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962459    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962462    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962465    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962469    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962472    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962475    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962478    2569 flags.go:64] FLAG: --port="10250"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962481    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962483    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc79186ecf98e2bb"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962487    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962489    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962492    2569 flags.go:64] FLAG: --register-node="true"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962495    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962498    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962501    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962503    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962506    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962509    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 21:05:38.970913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962512    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962515    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962517    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962520    2569 flags.go:64] FLAG: --runonce="false"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962522    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962527    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962530    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962533    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962535    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962538    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962541    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962544    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962546    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962550    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962553    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962555    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962558    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962561    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962563    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962568    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962571    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962574    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962577    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962580    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962583    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 21:05:38.971566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962585    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962588    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962591    2569 flags.go:64] FLAG: --v="2"
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962594    2569 flags.go:64] FLAG: --version="false"
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962598    2569 flags.go:64] FLAG: --vmodule=""
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962601    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.962604    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962745    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962751    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962754    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962757    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962760    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962764    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962766    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962769    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962771    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962774    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962776    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962779    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962781    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962785    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.972282 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962788    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962792    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962795    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962798    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962801    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962804    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962806    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962809    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962812    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962815    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962817    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962825    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962828    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962830    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962833    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962835    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962837    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962840    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962842    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.973206 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962845    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962847    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962850    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962854    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962858    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962863    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962865    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962874    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962877    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962881    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962883    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962886    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962890    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962893    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962896    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962898    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962901    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962904    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962906    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.974021 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962909    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962912    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962915    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962917    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962920    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962923    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962931    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962934    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962936    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962939    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962942    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962944    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962947    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962949    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962952    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962954    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962957    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962959    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962962    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962964    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.974822 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962967    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962969    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962972    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962974    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962977    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962980    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962983    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962985    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962988    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962990    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962993    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962995    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.962998    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963000    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963003    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963005    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963007    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963010    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963012    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.975367 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963022    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963024    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963026    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963029    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963031    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963034    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963036    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.963038    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.963702    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.974710    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.974727    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.975650    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.975664    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975755    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975763    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.975996 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975769    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975774    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975779    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975784    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975788    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975792    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975797    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975801    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975806    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975810    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975814    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975818    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975823    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975827    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975831    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975835    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975840    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975844    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975849    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975859    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.976801 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975864    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975868    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975872    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975876    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975880    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975884    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975888    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975893    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975898    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975902    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975906    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975910    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975914    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975918    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975923    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975927    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975931    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975935    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975939    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.977452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975943    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975947    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975951    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975955    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975960    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975966    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975972    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975976    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975981    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975985    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975989    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975993    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.975997    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976001    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976005    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976009    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976015    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976021    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976026    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.978095 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976031    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976036    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976040    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976045    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976050    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976054    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976059    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976063    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976067    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976073    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976078    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976083    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976087    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976091    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976095    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976099    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976103    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976108    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976112    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.978905 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976118    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976122    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976144    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976149    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976153    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976156    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976160    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976163    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976167    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976171    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976175    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976179    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976183    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976186    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976191    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976194    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976198    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976202    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976206    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.979544 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976209    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.976217    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976415    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976425    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976430    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976434    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976439    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976444    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976448    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976452    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976457    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976461    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976466    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976471    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976479    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:38.980194 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976485    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976489    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976493    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976498    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976502    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976506    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976511    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976515    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976520    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976524    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976528    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976534    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976540    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976545    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976550    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976554    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976559    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976564    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976568    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:38.980565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976573    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976578    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976582    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976586    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976591    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976595    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976599    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976604    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976608    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976612    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976616    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976620    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976625    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976629    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976633    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976637    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976642    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976648    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976653    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976657    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:38.981049 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976661    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976665    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976669    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976673    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976677    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976681    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976686    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976690    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976694    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976698    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976702    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976706    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976710    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976714    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976718    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976722    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976726    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976730    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976734    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976738    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:38.981557 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976742    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976747    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976750    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976754    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976758    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976762    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976767    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976771    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976775    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976779    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976784    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976787    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976791    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976795    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976799    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976803    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976807    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976811    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976815    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976819    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:38.982101 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976823    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976827    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976831    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976835    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976839    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976843    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:38.976847    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.976855    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.976998    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.979747    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.981786    2569 server.go:1019] "Starting client certificate rotation"
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.981888    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 21:05:38.982635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.981918    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 21:05:38.984400 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.984383    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 21:05:38.985614 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.985595    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 21:05:38.995803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.995789    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 22 21:05:38.999076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:38.998570    2569 log.go:25] "Validated CRI v1 image API"
Jul 22 21:05:39.002044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.002028    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 21:05:39.005154 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.005118    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 801c19d8-a0f4-4c8f-8a20-6242edf69125:/dev/nvme0n1p4 d6aec89d-b7e3-469d-9498-c78af5672827:/dev/nvme0n1p3]
Jul 22 21:05:39.005219 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.005153    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 21:05:39.010231 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.010100    2569 manager.go:216] Machine: {Timestamp:2026-07-22 21:05:39.008771085 +0000 UTC m=+0.346385958 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087595 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28892d3d5389c21510e1fe87131f83 SystemUUID:ec28892d-3d53-89c2-1510-e1fe87131f83 BootID:bd856943-2f7f-4655-8cf8-40f0b81b26da Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:87:89:1f:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:87:89:1f:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:e0:64:c0:22:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 21:05:39.010231 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.010228    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 21:05:39.010343 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.010297    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 21:05:39.013076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.013059    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 21:05:39.013531 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.013507    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 21:05:39.013687 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.013538    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 21:05:39.014303 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.014291    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 21:05:39.014364 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.014309    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 21:05:39.014364 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.014319    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 21:05:39.015046 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.015034    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 21:05:39.016450 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.016437    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 21:05:39.019702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019688    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 21:05:39.019832 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019820    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 21:05:39.019898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019859    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 21:05:39.019898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019873    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 21:05:39.019898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019894    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 21:05:39.020016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019906    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 22 21:05:39.020016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.019918    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 21:05:39.020291 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.020277    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 21:05:39.020352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.020302    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 21:05:39.022817 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.022801    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 21:05:39.025301 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.025287    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 21:05:39.025365 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.025319    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 21:05:39.026464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026453    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026468    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026474    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026479    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026487    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026492    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 21:05:39.026500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026500    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 21:05:39.026655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026504    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 21:05:39.026655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026510    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 21:05:39.026655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026515    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 21:05:39.026655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026523    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 21:05:39.026655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.026529    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 21:05:39.027413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.027402    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 21:05:39.027413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.027413    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 21:05:39.030471 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.030458    2569 server.go:1268] "Started kubelet"
Jul 22 21:05:39.030663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.030534    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 21:05:39.030663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.030527    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 21:05:39.030663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.030600    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 21:05:39.030999 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.030977    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 21:05:39.031071 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.030994    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 21:05:39.031071 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.031050    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 21:05:39.031427 ip-10-0-142-246 systemd[1]: Started Kubernetes Kubelet.
Jul 22 21:05:39.034956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.034935    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 21:05:39.035087 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.035018    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 21:05:39.035824 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.035803    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 21:05:39.038446 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.038429    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7pgfk"
Jul 22 21:05:39.041187 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.040177    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-246.ec2.internal.18c4b89d853efd68  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-246.ec2.internal,UID:ip-10-0-142-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-246.ec2.internal,},FirstTimestamp:2026-07-22 21:05:39.030433128 +0000 UTC m=+0.368047998,LastTimestamp:2026-07-22 21:05:39.030433128 +0000 UTC m=+0.368047998,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-246.ec2.internal,}"
Jul 22 21:05:39.041390 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.041373    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 21:05:39.041390 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.041377    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 21:05:39.041526 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.041474    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.042226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042082    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 21:05:39.042226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042101    2569 factory.go:55] Registering systemd factory
Jul 22 21:05:39.042226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042110    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 21:05:39.042226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042114    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 22 21:05:39.042226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042081    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042239    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042248    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042400    2569 factory.go:153] Registering CRI-O factory
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042415    2569 factory.go:223] Registration of the crio container factory successfully
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042461    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 21:05:39.042482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042482    2569 factory.go:103] Registering Raw factory
Jul 22 21:05:39.042874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042497    2569 manager.go:1196] Started watching for new ooms in manager
Jul 22 21:05:39.043039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.042885    2569 manager.go:349] Starting recovery of all containers
Jul 22 21:05:39.046434 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.046410    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7pgfk"
Jul 22 21:05:39.046890 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.046867    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 21:05:39.046975 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.046928    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 21:05:39.053862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.053760    2569 manager.go:354] Recovery completed
Jul 22 21:05:39.057730 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.057719    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.059700 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.059682    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.059786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.059712    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.059786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.059726    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.060176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060162    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 21:05:39.060176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060171    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.060176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060176    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 21:05:39.060346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060193    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 21:05:39.060827 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060811    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.060890 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060841    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.060890 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.060854    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.061379 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.061365    2569 policy_none.go:49] "None policy: Start"
Jul 22 21:05:39.061444 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.061383    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 21:05:39.061444 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.061396    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 21:05:39.061642 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.061560    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-246.ec2.internal.18c4b89d86fd8738  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-246.ec2.internal,UID:ip-10-0-142-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-246.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-246.ec2.internal,},FirstTimestamp:2026-07-22 21:05:39.059697464 +0000 UTC m=+0.397312332,LastTimestamp:2026-07-22 21:05:39.059697464 +0000 UTC m=+0.397312332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-246.ec2.internal,}"
Jul 22 21:05:39.062589 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.062577    2569 policy_none.go:47] "Start"
Jul 22 21:05:39.105687 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.105671    2569 manager.go:337] "Starting Device Plugin manager"
Jul 22 21:05:39.105765 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.105706    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 21:05:39.105765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.105719    2569 server.go:87] "Starting device plugin registration server"
Jul 22 21:05:39.105947 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.105934    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 21:05:39.106001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.105948    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 21:05:39.106045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.106030    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 21:05:39.106108 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.106097    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 21:05:39.106201 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.106110    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 21:05:39.106583 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.106563    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 21:05:39.106641 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.106618    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.143205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.143183    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 21:05:39.145432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.144424    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 21:05:39.145432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.144468    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 21:05:39.145432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.144494    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 21:05:39.145432 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.144530    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 21:05:39.146252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.146235    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:39.206443 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.206391    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.207681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.207663    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.207735 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.207695    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.207735 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.207705    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.207735 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.207725    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.215571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.215557    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.215614 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.215582    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-246.ec2.internal\": node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.228825 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.228807    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.244883 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.244865    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"]
Jul 22 21:05:39.244933 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.244916    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.245570 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.245554    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.245663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.245583    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.245663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.245594    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.246977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.246965    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.247114 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.247192 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247145    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.247548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247534    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.247629 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247558    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.247629 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247570    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.247707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247698    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.247743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247717    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.247743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.247726    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.252293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.252277    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.252368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.252306    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:39.252940 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.252923    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:39.253021 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.252951    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:39.253021 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.252969    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:39.259672 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.259653    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-246.ec2.internal\" not found" node="ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.265067 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.265053    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-246.ec2.internal\" not found" node="ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.329053 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.329034    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.429915 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.429883    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.443175 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.443158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.443245 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.443192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.443245 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.443210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a841b23908aa8cb00d9d94baa65ea6b1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-246.ec2.internal\" (UID: \"a841b23908aa8cb00d9d94baa65ea6b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.530620 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.530569    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.543927 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.543902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.544015 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.543937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.544015 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.543964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a841b23908aa8cb00d9d94baa65ea6b1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-246.ec2.internal\" (UID: \"a841b23908aa8cb00d9d94baa65ea6b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.544015 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.544004    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.544159 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.544018    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f52ed436efe9a9ecb153858944a128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal\" (UID: \"81f52ed436efe9a9ecb153858944a128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.544159 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.544017    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a841b23908aa8cb00d9d94baa65ea6b1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-246.ec2.internal\" (UID: \"a841b23908aa8cb00d9d94baa65ea6b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.563048 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.563029    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.568216 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.568196    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:39.631164 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.631113    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.731608 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.731583    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.832167 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.832105    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.932732 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:39.932702    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:39.980232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.980211    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 21:05:39.980710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:39.980343    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 21:05:40.033291 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.033268    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.046293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.046271    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:40.051242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.051218    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 21:00:39 +0000 UTC" deadline="2028-01-06 03:05:49.198756328 +0000 UTC"
Jul 22 21:05:40.051320 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.051242    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12774h0m9.147518618s"
Jul 22 21:05:40.134254 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.134230    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.195334 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:40.195304    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f52ed436efe9a9ecb153858944a128.slice/crio-77fa1b053617dd602f4f144ba047b92f10577846ab80364fe0694c46b9fa8be8 WatchSource:0}: Error finding container 77fa1b053617dd602f4f144ba047b92f10577846ab80364fe0694c46b9fa8be8: Status 404 returned error can't find the container with id 77fa1b053617dd602f4f144ba047b92f10577846ab80364fe0694c46b9fa8be8
Jul 22 21:05:40.199618 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.199602    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:05:40.235523 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.235500    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.273390 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.273370    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:40.335869 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.335842    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.436718 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.436663    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.536886 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:40.536862    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-246.ec2.internal\" not found"
Jul 22 21:05:40.611268 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.611242    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:40.641813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.641783    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:40.653765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.653745    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 21:05:40.654919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.654901    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal"
Jul 22 21:05:40.663515 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:40.663500    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 21:05:41.021646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.021608    2569 apiserver.go:52] "Watching apiserver"
Jul 22 21:05:41.032097 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.032073    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 21:05:41.034564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.034539    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bjb5g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal","openshift-multus/multus-additional-cni-plugins-fzcmc","openshift-multus/multus-bjt5r","kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65","openshift-multus/network-metrics-daemon-z7shg","openshift-network-diagnostics/network-check-target-4mhxx","openshift-network-operator/iptables-alerter-7tnbx","openshift-ovn-kubernetes/ovnkube-node-n7rl9","kube-system/global-pull-secret-syncer-xwpsw","kube-system/konnectivity-agent-49s67","openshift-cluster-node-tuning-operator/tuned-8gqf2","openshift-dns/node-resolver-w76cl"]
Jul 22 21:05:41.036252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.036232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.036352 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.036320    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:41.038144 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.038102    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.038243 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.038184    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:41.039462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.039440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.040812 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.040790    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.041893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.041872    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 21:05:41.042509 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042473    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.042618 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042589    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.042618 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042605    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 21:05:41.042756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042734    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l8mk4\""
Jul 22 21:05:41.042893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042775    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 21:05:41.042893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042832    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.042893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.042876    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 21:05:41.043267 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.043241    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 21:05:41.043378 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.043286    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-45g5p\""
Jul 22 21:05:41.044233 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.044210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.046142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.045728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.046142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.045743    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.046142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.045989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.046142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.046129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pgrh7\""
Jul 22 21:05:41.047302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.046922    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvvrt\""
Jul 22 21:05:41.047302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.046941    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 21:05:41.047302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.046987    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.047302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.046931    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.047302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.047244    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.048369 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.048347    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 21:05:41.048639 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.048615    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.048743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.048685    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n7hh8\""
Jul 22 21:05:41.048743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.048698    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.048891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.048871    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:41.048959 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.048943    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:41.049969 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.049942    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.050068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.049999    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8sblh\""
Jul 22 21:05:41.050425 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.050406    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.050858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.050835    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.051375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051356    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-socket-dir-parent\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.051462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-system-cni-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.051462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.051462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltpmr\" (UniqueName: \"kubernetes.io/projected/7a76272e-c625-4fe9-9a9c-bd16bf90c930-kube-api-access-ltpmr\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.051462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-os-release\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-dbus\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-system-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-bin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051610    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-conf-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-hosts-file\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051643    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-multus\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.051681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-multus-daemon-config\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7js9p\" (UniqueName: \"kubernetes.io/projected/0df5b237-8912-4810-8fcb-30b1df5f55a4-kube-api-access-7js9p\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-kubelet-config\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-cni-binary-copy\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-kubelet\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-hostroot\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-cnibin\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051877    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-k8s-cni-cncf-io\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-netns\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051908    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-etc-kubernetes\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-tmp-dir\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-multus-certs\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxz4q\" (UniqueName: \"kubernetes.io/projected/ae49317d-da46-4588-9c50-461366811fb8-kube-api-access-pxz4q\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051972    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpg6q\" (UniqueName: \"kubernetes.io/projected/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-kube-api-access-mpg6q\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.051994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-cnibin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.052062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.052012    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-os-release\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.053697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.053680    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.054590 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.054184    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmw94\""
Jul 22 21:05:41.054590 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.054232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 21:05:41.054590 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.054349    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055568    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055594    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055658    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055575    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055728    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 21:05:41.056094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.055739    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.056454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.056315    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 21:05:41.056454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.056443    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-srggh\""
Jul 22 21:05:41.056551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.056500    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 21:05:41.056551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.056502    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 21:05:41.061564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.061544    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 21:05:41.062052 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.061569    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 21:05:41.062052 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.062046    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgk9s\""
Jul 22 21:05:41.079032 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.079011    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-csgrt"
Jul 22 21:05:41.087919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.087889    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-csgrt"
Jul 22 21:05:41.143258 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.143238    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 21:05:41.148960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.148914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal" event={"ID":"81f52ed436efe9a9ecb153858944a128","Type":"ContainerStarted","Data":"77fa1b053617dd602f4f144ba047b92f10577846ab80364fe0694c46b9fa8be8"}
Jul 22 21:05:41.152230 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-multus-daemon-config\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.152313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.152313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-kubelet-config\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.152313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5mvw\" (UniqueName: \"kubernetes.io/projected/3b05f169-b50f-46d2-8b27-851e99a1263c-kube-api-access-s5mvw\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.152313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-kubernetes\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.152313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-netns\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.152543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152335    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.152543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-kubelet-config\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.152620 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-run\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.152620 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-slash\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.152696 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-var-lib-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.152696 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.152772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-cnibin\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.152772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-k8s-cni-cncf-io\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.152772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-tmp-dir\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-bin\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-multus-certs\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-k8s-cni-cncf-io\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxz4q\" (UniqueName: \"kubernetes.io/projected/ae49317d-da46-4588-9c50-461366811fb8-kube-api-access-pxz4q\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b05f169-b50f-46d2-8b27-851e99a1263c-host-slash\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.152912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-cnibin\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-multus-certs\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152919    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-multus-daemon-config\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-systemd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-ovn\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.152991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-os-release\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153043    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-system-cni-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-modprobe-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153104    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-os-release\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.153120    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-config\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153145    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-system-cni-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153190    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.153217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltpmr\" (UniqueName: \"kubernetes.io/projected/7a76272e-c625-4fe9-9a9c-bd16bf90c930-kube-api-access-ltpmr\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-tmp-dir\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.153253    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:05:41.653218994 +0000 UTC m=+2.990833851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.153276    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-systemd\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153317    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-registration-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.153343    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:41.653331519 +0000 UTC m=+2.990946375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-os-release\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-dbus\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-system-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153458    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-conf-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153467    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-os-release\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153492    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-system-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-hosts-file\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08e931fb-ee7a-4868-af7f-30b6901e8b9c-dbus\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.153957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-host\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153542    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-hosts-file\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-cni-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-conf-dir\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-etc-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-tuned\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4kpk\" (UniqueName: \"kubernetes.io/projected/bbc491f2-9c18-4d74-973d-276eca48b2bc-kube-api-access-v4kpk\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe7ad62-5387-4b4c-a773-a9144974a8a0-host\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe7ad62-5387-4b4c-a773-a9144974a8a0-serviceca\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-multus\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7js9p\" (UniqueName: \"kubernetes.io/projected/0df5b237-8912-4810-8fcb-30b1df5f55a4-kube-api-access-7js9p\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysconfig\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-var-lib-kubelet\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153883    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-multus\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-cni-binary-copy\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.154608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-kubelet\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-hostroot\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.153995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-lib-modules\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-socket-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-netns\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0df5b237-8912-4810-8fcb-30b1df5f55a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-etc-kubernetes\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-kubelet\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154132    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-etc-kubernetes\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154126    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-log-socket\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154168    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-hostroot\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154197    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154201    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-run-netns\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjdtl\" (UniqueName: \"kubernetes.io/projected/4fe7ad62-5387-4b4c-a773-a9144974a8a0-kube-api-access-cjdtl\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpg6q\" (UniqueName: \"kubernetes.io/projected/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-kube-api-access-mpg6q\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-conf\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-kubelet\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-systemd-units\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-device-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154348    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv74q\" (UniqueName: \"kubernetes.io/projected/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kube-api-access-dv74q\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-agent-certs\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-sys\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-cnibin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154426    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae49317d-da46-4588-9c50-461366811fb8-cni-binary-copy\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-socket-dir-parent\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b05f169-b50f-46d2-8b27-851e99a1263c-iptables-alerter-script\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-multus-socket-dir-parent\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154513    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154574    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-cnibin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-sys-fs\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154603    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-node-log\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-env-overrides\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.155919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-bin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-tmp\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154743    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae49317d-da46-4588-9c50-461366811fb8-host-var-lib-cni-bin\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjm9\" (UniqueName: \"kubernetes.io/projected/7f804d12-eb4a-447d-a18f-79ef0440b042-kube-api-access-cfjm9\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-netd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-script-lib\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154855    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df5b237-8912-4810-8fcb-30b1df5f55a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-konnectivity-ca\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.156503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.154938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovn-node-metrics-cert\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.162042 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.162009    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 21:05:41.165956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.165932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7js9p\" (UniqueName: \"kubernetes.io/projected/0df5b237-8912-4810-8fcb-30b1df5f55a4-kube-api-access-7js9p\") pod \"multus-additional-cni-plugins-fzcmc\" (UID: \"0df5b237-8912-4810-8fcb-30b1df5f55a4\") " pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.166052 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.165935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltpmr\" (UniqueName: \"kubernetes.io/projected/7a76272e-c625-4fe9-9a9c-bd16bf90c930-kube-api-access-ltpmr\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.166052 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.165943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxz4q\" (UniqueName: \"kubernetes.io/projected/ae49317d-da46-4588-9c50-461366811fb8-kube-api-access-pxz4q\") pod \"multus-bjt5r\" (UID: \"ae49317d-da46-4588-9c50-461366811fb8\") " pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.166432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.166410    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpg6q\" (UniqueName: \"kubernetes.io/projected/ea6ceeb0-3728-40fa-a2ac-3e584cf079b8-kube-api-access-mpg6q\") pod \"node-resolver-w76cl\" (UID: \"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8\") " pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.255567 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255534    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjm9\" (UniqueName: \"kubernetes.io/projected/7f804d12-eb4a-447d-a18f-79ef0440b042-kube-api-access-cfjm9\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.255567 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-netd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-script-lib\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-konnectivity-ca\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovn-node-metrics-cert\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5mvw\" (UniqueName: \"kubernetes.io/projected/3b05f169-b50f-46d2-8b27-851e99a1263c-kube-api-access-s5mvw\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-kubernetes\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-netns\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-run\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.255756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-slash\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-var-lib-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-bin\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255845    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b05f169-b50f-46d2-8b27-851e99a1263c-host-slash\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-systemd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-ovn\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-modprobe-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-config\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-systemd\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-netd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.255981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-registration-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-host\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-registration-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-etc-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-tuned\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256083    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-kubernetes\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4kpk\" (UniqueName: \"kubernetes.io/projected/bbc491f2-9c18-4d74-973d-276eca48b2bc-kube-api-access-v4kpk\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-netns\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe7ad62-5387-4b4c-a773-a9144974a8a0-host\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-run\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe7ad62-5387-4b4c-a773-a9144974a8a0-serviceca\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256182    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-slash\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-host\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256245    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-ovn\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysconfig\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-systemd\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-var-lib-kubelet\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-lib-modules\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256322    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-var-lib-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-socket-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256349    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-modprobe-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-log-socket\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.256641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjdtl\" (UniqueName: \"kubernetes.io/projected/4fe7ad62-5387-4b4c-a773-a9144974a8a0-kube-api-access-cjdtl\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-cni-bin\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-conf\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-kubelet\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-systemd-units\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-device-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-d\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv74q\" (UniqueName: \"kubernetes.io/projected/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kube-api-access-dv74q\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-agent-certs\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-sys\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b05f169-b50f-46d2-8b27-851e99a1263c-iptables-alerter-script\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-sys-fs\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-node-log\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe7ad62-5387-4b4c-a773-a9144974a8a0-serviceca\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.257389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-env-overrides\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-tmp\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256825    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-etc-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256835    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-konnectivity-ca\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256868    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-script-lib\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256914    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovnkube-config\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe7ad62-5387-4b4c-a773-a9144974a8a0-host\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.256982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257076    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-lib-modules\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-socket-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b05f169-b50f-46d2-8b27-851e99a1263c-host-slash\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257251    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-node-log\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-run-openvswitch\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-sys\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysconfig\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257366    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-log-socket\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-systemd-units\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.258185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257332    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-sys-fs\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257473    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-systemd\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257491    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2251433a-4dc5-48ea-8cf3-bc79f4261e33-device-dir\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc491f2-9c18-4d74-973d-276eca48b2bc-host-kubelet\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257653    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-var-lib-kubelet\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257744    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc491f2-9c18-4d74-973d-276eca48b2bc-env-overrides\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-sysctl-conf\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.257980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b05f169-b50f-46d2-8b27-851e99a1263c-iptables-alerter-script\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.259347    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc491f2-9c18-4d74-973d-276eca48b2bc-ovn-node-metrics-cert\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.260002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb25f2a8-daa1-4402-b583-faf09c6f8e9f-agent-certs\") pod \"konnectivity-agent-49s67\" (UID: \"eb25f2a8-daa1-4402-b583-faf09c6f8e9f\") " pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.260626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-etc-tuned\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.262823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.260682    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f804d12-eb4a-447d-a18f-79ef0440b042-tmp\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.263401 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.263339    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:41.263401 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.263358    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:41.263401 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.263370    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:41.263622 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.263440    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:41.763417971 +0000 UTC m=+3.101032842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:41.266493 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.266455    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv74q\" (UniqueName: \"kubernetes.io/projected/2251433a-4dc5-48ea-8cf3-bc79f4261e33-kube-api-access-dv74q\") pod \"aws-ebs-csi-driver-node-hkb65\" (UID: \"2251433a-4dc5-48ea-8cf3-bc79f4261e33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.266791 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.266773    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4kpk\" (UniqueName: \"kubernetes.io/projected/bbc491f2-9c18-4d74-973d-276eca48b2bc-kube-api-access-v4kpk\") pod \"ovnkube-node-n7rl9\" (UID: \"bbc491f2-9c18-4d74-973d-276eca48b2bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.267176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.267152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjdtl\" (UniqueName: \"kubernetes.io/projected/4fe7ad62-5387-4b4c-a773-a9144974a8a0-kube-api-access-cjdtl\") pod \"node-ca-bjb5g\" (UID: \"4fe7ad62-5387-4b4c-a773-a9144974a8a0\") " pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.267289 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.267193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjm9\" (UniqueName: \"kubernetes.io/projected/7f804d12-eb4a-447d-a18f-79ef0440b042-kube-api-access-cfjm9\") pod \"tuned-8gqf2\" (UID: \"7f804d12-eb4a-447d-a18f-79ef0440b042\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.268927 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.268904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5mvw\" (UniqueName: \"kubernetes.io/projected/3b05f169-b50f-46d2-8b27-851e99a1263c-kube-api-access-s5mvw\") pod \"iptables-alerter-7tnbx\" (UID: \"3b05f169-b50f-46d2-8b27-851e99a1263c\") " pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.353344 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.353281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fzcmc"
Jul 22 21:05:41.362463 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.362438    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df5b237_8912_4810_8fcb_30b1df5f55a4.slice/crio-d706076649e92a519b5a7bc0e76c2853596fef751ddd88674092af185e71c784 WatchSource:0}: Error finding container d706076649e92a519b5a7bc0e76c2853596fef751ddd88674092af185e71c784: Status 404 returned error can't find the container with id d706076649e92a519b5a7bc0e76c2853596fef751ddd88674092af185e71c784
Jul 22 21:05:41.365697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.365674    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjt5r"
Jul 22 21:05:41.374109 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.374089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w76cl"
Jul 22 21:05:41.376551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.376534    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:41.378666 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.378652    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65"
Jul 22 21:05:41.389070 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.389046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7tnbx"
Jul 22 21:05:41.389833 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.389810    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2251433a_4dc5_48ea_8cf3_bc79f4261e33.slice/crio-5913cc112b26f5bdacb6f55e38ee0221af0d20235ef438e05d2af4b5715d443b WatchSource:0}: Error finding container 5913cc112b26f5bdacb6f55e38ee0221af0d20235ef438e05d2af4b5715d443b: Status 404 returned error can't find the container with id 5913cc112b26f5bdacb6f55e38ee0221af0d20235ef438e05d2af4b5715d443b
Jul 22 21:05:41.390644 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.390623    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6ceeb0_3728_40fa_a2ac_3e584cf079b8.slice/crio-d26ca49faea25b3f5626811adbe029e4bcc5a0f340854c068e7c4310b07abd73 WatchSource:0}: Error finding container d26ca49faea25b3f5626811adbe029e4bcc5a0f340854c068e7c4310b07abd73: Status 404 returned error can't find the container with id d26ca49faea25b3f5626811adbe029e4bcc5a0f340854c068e7c4310b07abd73
Jul 22 21:05:41.391299 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.391280    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae49317d_da46_4588_9c50_461366811fb8.slice/crio-2c62b0fd57d43a4851b5049425002c9c0ea8fdbc69f266b18124ba1517a5565f WatchSource:0}: Error finding container 2c62b0fd57d43a4851b5049425002c9c0ea8fdbc69f266b18124ba1517a5565f: Status 404 returned error can't find the container with id 2c62b0fd57d43a4851b5049425002c9c0ea8fdbc69f266b18124ba1517a5565f
Jul 22 21:05:41.396841 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.396822    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gqf2"
Jul 22 21:05:41.399748 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.399726    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b05f169_b50f_46d2_8b27_851e99a1263c.slice/crio-3324dbd6e1370060155abdd0cb492745e7dcbde5b282dcbc6563dfa05803b7c0 WatchSource:0}: Error finding container 3324dbd6e1370060155abdd0cb492745e7dcbde5b282dcbc6563dfa05803b7c0: Status 404 returned error can't find the container with id 3324dbd6e1370060155abdd0cb492745e7dcbde5b282dcbc6563dfa05803b7c0
Jul 22 21:05:41.403932 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.403913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:05:41.405804 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.405783    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f804d12_eb4a_447d_a18f_79ef0440b042.slice/crio-63ac963d49998a6e5fca075d291b8ac99575855c002a1c58cd04e520363138cd WatchSource:0}: Error finding container 63ac963d49998a6e5fca075d291b8ac99575855c002a1c58cd04e520363138cd: Status 404 returned error can't find the container with id 63ac963d49998a6e5fca075d291b8ac99575855c002a1c58cd04e520363138cd
Jul 22 21:05:41.411747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.411724    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjb5g"
Jul 22 21:05:41.415919 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.415900    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc491f2_9c18_4d74_973d_276eca48b2bc.slice/crio-c32f9ffa90c11ab17b9fcd4565feb8868f28aa505b9514ad0c4a9ef1bcf5fcbd WatchSource:0}: Error finding container c32f9ffa90c11ab17b9fcd4565feb8868f28aa505b9514ad0c4a9ef1bcf5fcbd: Status 404 returned error can't find the container with id c32f9ffa90c11ab17b9fcd4565feb8868f28aa505b9514ad0c4a9ef1bcf5fcbd
Jul 22 21:05:41.416921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.416902    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:05:41.421792 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.421767    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe7ad62_5387_4b4c_a773_a9144974a8a0.slice/crio-48052edf72de7c84c6bd830b087067c0f45aad0e10080992e25a342f418de58e WatchSource:0}: Error finding container 48052edf72de7c84c6bd830b087067c0f45aad0e10080992e25a342f418de58e: Status 404 returned error can't find the container with id 48052edf72de7c84c6bd830b087067c0f45aad0e10080992e25a342f418de58e
Jul 22 21:05:41.429463 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.429446    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb25f2a8_daa1_4402_b583_faf09c6f8e9f.slice/crio-a31d1ace6d7403ddf76cd524aab60b6d35c6ee03fc8d7c90ba3c25f4478c5d4c WatchSource:0}: Error finding container a31d1ace6d7403ddf76cd524aab60b6d35c6ee03fc8d7c90ba3c25f4478c5d4c: Status 404 returned error can't find the container with id a31d1ace6d7403ddf76cd524aab60b6d35c6ee03fc8d7c90ba3c25f4478c5d4c
Jul 22 21:05:41.659720 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.659558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:41.659825 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.659754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:41.659825 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.659700    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:41.659922 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.659862    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:41.659922 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.659857    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:05:42.659837068 +0000 UTC m=+3.997451930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:41.659922 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.659900    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:42.659889397 +0000 UTC m=+3.997504258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:41.805055 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:05:41.805033    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda841b23908aa8cb00d9d94baa65ea6b1.slice/crio-3c9fab51dd3232b9a57593670e03d1c4ee8bfe92bc5829ea4adb23bdf4c2b691 WatchSource:0}: Error finding container 3c9fab51dd3232b9a57593670e03d1c4ee8bfe92bc5829ea4adb23bdf4c2b691: Status 404 returned error can't find the container with id 3c9fab51dd3232b9a57593670e03d1c4ee8bfe92bc5829ea4adb23bdf4c2b691
Jul 22 21:05:41.861572 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:41.861546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:41.861732 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.861716    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:41.861788 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.861737    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:41.861788 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.861746    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:41.861914 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:41.861805    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:42.861786736 +0000 UTC m=+4.199401609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:42.090524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.090422    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 21:00:41 +0000 UTC" deadline="2028-04-04 23:53:24.369148446 +0000 UTC"
Jul 22 21:05:42.090524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.090460    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14930h47m42.278694948s"
Jul 22 21:05:42.145302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.144734    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:42.145302 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.144864    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:42.153872 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.153822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tnbx" event={"ID":"3b05f169-b50f-46d2-8b27-851e99a1263c","Type":"ContainerStarted","Data":"3324dbd6e1370060155abdd0cb492745e7dcbde5b282dcbc6563dfa05803b7c0"}
Jul 22 21:05:42.155436 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.155353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjt5r" event={"ID":"ae49317d-da46-4588-9c50-461366811fb8","Type":"ContainerStarted","Data":"2c62b0fd57d43a4851b5049425002c9c0ea8fdbc69f266b18124ba1517a5565f"}
Jul 22 21:05:42.158225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.157895    2569 generic.go:356] "Generic (PLEG): container finished" podID="81f52ed436efe9a9ecb153858944a128" containerID="23dff6a7e338fb68a2cf34e8d7b21ba076d525f22cb31ffba8058dc9531f3124" exitCode=0
Jul 22 21:05:42.158225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.157959    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal" event={"ID":"81f52ed436efe9a9ecb153858944a128","Type":"ContainerDied","Data":"23dff6a7e338fb68a2cf34e8d7b21ba076d525f22cb31ffba8058dc9531f3124"}
Jul 22 21:05:42.160236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.160172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal" event={"ID":"a841b23908aa8cb00d9d94baa65ea6b1","Type":"ContainerStarted","Data":"3c9fab51dd3232b9a57593670e03d1c4ee8bfe92bc5829ea4adb23bdf4c2b691"}
Jul 22 21:05:42.163347 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.163209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49s67" event={"ID":"eb25f2a8-daa1-4402-b583-faf09c6f8e9f","Type":"ContainerStarted","Data":"a31d1ace6d7403ddf76cd524aab60b6d35c6ee03fc8d7c90ba3c25f4478c5d4c"}
Jul 22 21:05:42.168696 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.168594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"c32f9ffa90c11ab17b9fcd4565feb8868f28aa505b9514ad0c4a9ef1bcf5fcbd"}
Jul 22 21:05:42.172939 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.172918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w76cl" event={"ID":"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8","Type":"ContainerStarted","Data":"d26ca49faea25b3f5626811adbe029e4bcc5a0f340854c068e7c4310b07abd73"}
Jul 22 21:05:42.191618 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.191496    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65" event={"ID":"2251433a-4dc5-48ea-8cf3-bc79f4261e33","Type":"ContainerStarted","Data":"5913cc112b26f5bdacb6f55e38ee0221af0d20235ef438e05d2af4b5715d443b"}
Jul 22 21:05:42.205119 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.205077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerStarted","Data":"d706076649e92a519b5a7bc0e76c2853596fef751ddd88674092af185e71c784"}
Jul 22 21:05:42.208275 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.208246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjb5g" event={"ID":"4fe7ad62-5387-4b4c-a773-a9144974a8a0","Type":"ContainerStarted","Data":"48052edf72de7c84c6bd830b087067c0f45aad0e10080992e25a342f418de58e"}
Jul 22 21:05:42.243374 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.243343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gqf2" event={"ID":"7f804d12-eb4a-447d-a18f-79ef0440b042","Type":"ContainerStarted","Data":"63ac963d49998a6e5fca075d291b8ac99575855c002a1c58cd04e520363138cd"}
Jul 22 21:05:42.666599 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.666558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:42.666793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.666628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:42.666857 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.666806    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:42.666909 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.666869    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:44.666849989 +0000 UTC m=+6.004464850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:42.667371 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.667349    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:42.667466 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.667410    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:05:44.667393676 +0000 UTC m=+6.005008540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:42.868035 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:42.867993    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:42.868248 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.868189    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:42.868248 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.868209    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:42.868248 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.868224    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:42.868420 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:42.868285    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:44.868263595 +0000 UTC m=+6.205878456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:43.091247 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.091119    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 21:00:41 +0000 UTC" deadline="2028-05-02 17:12:54.678060322 +0000 UTC"
Jul 22 21:05:43.091247 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.091202    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15596h7m11.586862601s"
Jul 22 21:05:43.147101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.146346    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:43.147101 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:43.146487    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:43.147101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.146917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:43.147101 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:43.147019    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:43.253462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.252690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal" event={"ID":"81f52ed436efe9a9ecb153858944a128","Type":"ContainerStarted","Data":"933ed17ce85c0c47c21793aa211a3b06b94456103198671e6e22599fa9dca6d9"}
Jul 22 21:05:43.274866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:43.274189    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-246.ec2.internal" podStartSLOduration=3.274166756 podStartE2EDuration="3.274166756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:43.273458866 +0000 UTC m=+4.611073750" watchObservedRunningTime="2026-07-22 21:05:43.274166756 +0000 UTC m=+4.611781640"
Jul 22 21:05:44.145614 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:44.145571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:44.146077 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.145705    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:44.682054 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:44.682018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:44.682253 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:44.682068    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:44.682253 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.682225    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:44.682363 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.682290    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:05:48.682272413 +0000 UTC m=+10.019887286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:44.682811 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.682724    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:44.682811 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.682790    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:48.682774139 +0000 UTC m=+10.020388997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:44.884928 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:44.884353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:44.884928 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.884515    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:44.884928 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.884540    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:44.884928 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.884552    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:44.884928 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:44.884603    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:48.884586737 +0000 UTC m=+10.222201599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:45.146334 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:45.145715    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:45.146334 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:45.145842    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:45.146817 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:45.146603    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:45.146817 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:45.146717    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:46.145243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:46.145209    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:46.145441 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:46.145340    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:47.145262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:47.145235    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:47.145615 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:47.145361    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:47.145849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:47.145700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:47.145849 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:47.145808    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:48.145153 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:48.144972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:48.145153 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.145091    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:48.716872 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:48.716829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:48.716872 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:48.716875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:48.717068 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.716974    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:48.717068 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.717023    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.717010384 +0000 UTC m=+18.054625239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:48.717382 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.717367    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:48.717457 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.717414    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.717398415 +0000 UTC m=+18.055013272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:48.919444 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:48.919359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:48.919600 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.919549    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:48.919600 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.919574    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:48.919600 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.919590    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:48.919754 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:48.919650    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.919631006 +0000 UTC m=+18.257245866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:49.146091 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:49.146011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:49.146521 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:49.146108    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:49.146521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:49.146216    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:49.146521 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:49.146350    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:50.145216 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:50.145184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:50.145391 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:50.145310    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:51.145544 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:51.145504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:51.145544 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:51.145548    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:51.146095 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:51.145651    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:51.146095 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:51.145737    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:52.145664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:52.145587    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:52.146018 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:52.145686    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:53.145722 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:53.145656    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:53.146080 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:53.145667    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:53.146080 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:53.145773    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:53.146080 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:53.145845    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:54.145030 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:54.144999    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:54.145214 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:54.145123    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:55.144790 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:55.144761    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:55.145263 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:55.144871    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:55.145263 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:55.144969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:55.145263 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:55.145089    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:56.145166 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:56.145118    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:56.145651 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.145249    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:56.784112 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:56.784083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:56.784276 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:56.784121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:56.784276 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.784223    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:56.784276 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.784228    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:56.784366 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.784278    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:12.784265424 +0000 UTC m=+34.121880280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:56.784366 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.784290    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:06:12.784284573 +0000 UTC m=+34.121899429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:56.986001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:56.985975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:56.986170 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.986150    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:56.986170 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.986167    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:56.986275 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.986176    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:56.986275 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:56.986226    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:12.986213215 +0000 UTC m=+34.323828076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:57.145111 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:57.145026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:57.145271 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:57.145187    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:05:57.145271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:57.145221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:57.145647 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:57.145332    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:58.145659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:58.145625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:05:58.146048 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:58.145762    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:05:59.146120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:59.146089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:05:59.146588 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:59.146199    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:05:59.146588 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:05:59.146248    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:05:59.146588 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:05:59.146315    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:00.145158 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:00.145114    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:00.145312 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:00.145239    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:01.145469 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:01.145441    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:01.145904 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:01.145542    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:01.145904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:01.145600    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:01.145904 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:01.145718    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:02.145352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.145057    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:02.145458 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:02.145428    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:02.294194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.294159    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65" event={"ID":"2251433a-4dc5-48ea-8cf3-bc79f4261e33","Type":"ContainerStarted","Data":"1606bae81e43fd78f82429117af244ac36eeae09175298f8a070559b29277393"}
Jul 22 21:06:02.295664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.295638    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="3bd9d7c64e3063183fe4799dad92f07f7922052ec5d48d1b4ffe6a6c2eb97d09" exitCode=0
Jul 22 21:06:02.295778 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.295725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"3bd9d7c64e3063183fe4799dad92f07f7922052ec5d48d1b4ffe6a6c2eb97d09"}
Jul 22 21:06:02.297106 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.297067    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjb5g" event={"ID":"4fe7ad62-5387-4b4c-a773-a9144974a8a0","Type":"ContainerStarted","Data":"79ef93a753505344e9be022ad0130c5ed56fccc3146e676b6506291c5a47c340"}
Jul 22 21:06:02.298654 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.298604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gqf2" event={"ID":"7f804d12-eb4a-447d-a18f-79ef0440b042","Type":"ContainerStarted","Data":"b36075ad9ca35d4d1ef966cf57f802d74a2d260387f98c03350b594548c34933"}
Jul 22 21:06:02.301342 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.301324    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjt5r" event={"ID":"ae49317d-da46-4588-9c50-461366811fb8","Type":"ContainerStarted","Data":"75157aec0de110bbd80d6c887bf41d37eb9d710a463bbcd0545cec3aa26df877"}
Jul 22 21:06:02.302620 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.302589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal" event={"ID":"a841b23908aa8cb00d9d94baa65ea6b1","Type":"ContainerStarted","Data":"72ae259b77416caa4a5e473f231fd883900719b014129d903c15afed6bdb92d4"}
Jul 22 21:06:02.304076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.304046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49s67" event={"ID":"eb25f2a8-daa1-4402-b583-faf09c6f8e9f","Type":"ContainerStarted","Data":"01d9e432e4e8b4204ed20fea12148ba99785ce5d5fad3c8bae3bb0eb3c25d3cf"}
Jul 22 21:06:02.306696 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.306681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:06:02.306975 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.306959    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbc491f2-9c18-4d74-973d-276eca48b2bc" containerID="930d21cc135b38607b9b8fc1b109bbb13047b309a7bb5f7426b716cbe9f7a19e" exitCode=1
Jul 22 21:06:02.307040 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307014    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"62d4860172c0f1abe0f70cb03187cba052544535977d49998934116cc933cdd4"}
Jul 22 21:06:02.307104 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"f848d96986a13560e6d75b47df3fd4ec206ece79ccfdbc91eb646cdc4b759223"}
Jul 22 21:06:02.307212 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307159    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"93327f813e46109f8fee4e9dfb59c9767936b08e5780bfc98e46c9f72e86152f"}
Jul 22 21:06:02.307258 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307211    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"373c4b65f8928de435a0e8fe9219f67441bf3984997afc009a4387214fd0bbe3"}
Jul 22 21:06:02.307258 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerDied","Data":"930d21cc135b38607b9b8fc1b109bbb13047b309a7bb5f7426b716cbe9f7a19e"}
Jul 22 21:06:02.307353 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.307286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"b931e5e59e523084b9e38912b9c84a3722f7bac5c26778a6a6e13eced09a625f"}
Jul 22 21:06:02.308353 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.308335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w76cl" event={"ID":"ea6ceeb0-3728-40fa-a2ac-3e584cf079b8","Type":"ContainerStarted","Data":"6b9870e33d4e6c86bad34a10b3447798751f6aca24fdf3b227512741a931ff46"}
Jul 22 21:06:02.329827 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.329793    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-246.ec2.internal" podStartSLOduration=22.329780698 podStartE2EDuration="22.329780698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.329218484 +0000 UTC m=+23.666833361" watchObservedRunningTime="2026-07-22 21:06:02.329780698 +0000 UTC m=+23.667395575"
Jul 22 21:06:02.343511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.343477    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjb5g" podStartSLOduration=12.965386381 podStartE2EDuration="23.343469178s" totalImagesPullingTime="10.378082797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.34329041 +0000 UTC m=+23.680905288" watchObservedRunningTime="2026-07-22 21:06:02.343469178 +0000 UTC m=+23.681084070"
Jul 22 21:06:02.358715 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.358681    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-49s67" podStartSLOduration=12.066021226 podStartE2EDuration="23.358671875s" totalImagesPullingTime="11.292650649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.358351662 +0000 UTC m=+23.695966550" watchObservedRunningTime="2026-07-22 21:06:02.358671875 +0000 UTC m=+23.696286753"
Jul 22 21:06:02.375693 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.375660    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bjt5r" podStartSLOduration=3.486519043 podStartE2EDuration="23.375651013s" totalImagesPullingTime="19.88913197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.3756156 +0000 UTC m=+23.713230477" watchObservedRunningTime="2026-07-22 21:06:02.375651013 +0000 UTC m=+23.713265890"
Jul 22 21:06:02.390749 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.390716    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w76cl" podStartSLOduration=15.512272496 podStartE2EDuration="23.390706858s" totalImagesPullingTime="7.878434362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.390389413 +0000 UTC m=+23.728004303" watchObservedRunningTime="2026-07-22 21:06:02.390706858 +0000 UTC m=+23.728321736"
Jul 22 21:06:02.415221 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.415193    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8gqf2" podStartSLOduration=3.5942734 podStartE2EDuration="23.415182529s" totalImagesPullingTime="19.820909129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:02.414954684 +0000 UTC m=+23.752569561" watchObservedRunningTime="2026-07-22 21:06:02.415182529 +0000 UTC m=+23.752797435"
Jul 22 21:06:02.527454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.527429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:02.639855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.639807    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:02.804998 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.804973    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:06:02.805641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.805621    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:06:02.835204 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:02.835183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:03.145282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.145251    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:03.145559 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.145295    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:03.145559 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:03.145387    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:03.145559 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:03.145505    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:03.312778 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.312745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7tnbx" event={"ID":"3b05f169-b50f-46d2-8b27-851e99a1263c","Type":"ContainerStarted","Data":"fb8744b51011598aa3eed94a4a0e80d677a6688a2e0f39fb059515bf71be871e"}
Jul 22 21:06:03.313332 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.313308    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:06:03.313611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.313591    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-49s67"
Jul 22 21:06:03.328063 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.328014    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7tnbx" podStartSLOduration=4.533434912 podStartE2EDuration="24.328001863s" totalImagesPullingTime="19.794566951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:03.327843874 +0000 UTC m=+24.665458751" watchObservedRunningTime="2026-07-22 21:06:03.328001863 +0000 UTC m=+24.665616740"
Jul 22 21:06:03.447883 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.447791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:03.558304 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.558276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:03.813276 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:03.813253    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 21:06:04.120676 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.120492    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T21:06:03.813271719Z","UUID":"5b453c3e-3305-4fd1-8f89-1d6c11622378","Handler":null,"Name":"","Endpoint":""}
Jul 22 21:06:04.123001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.122978    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 21:06:04.123117 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.123032    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 21:06:04.144786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.144762    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:04.144944 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:04.144887    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:04.317104 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.317083    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:06:04.317534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.317512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"e8da12ae279d4616b841419e641bbf89e7f0d415005826ad4728a80c3c37eeb2"}
Jul 22 21:06:04.319879 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:04.319852    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65" event={"ID":"2251433a-4dc5-48ea-8cf3-bc79f4261e33","Type":"ContainerStarted","Data":"04b761f7f9cb442e60087408513d9d05e1ebfe34adb4632ab1072f93146a6e1e"}
Jul 22 21:06:05.145368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:05.145122    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:05.145539 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:05.145148    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:05.145612 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:05.145559    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:05.145686 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:05.145663    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:05.324314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:05.324280    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65" event={"ID":"2251433a-4dc5-48ea-8cf3-bc79f4261e33","Type":"ContainerStarted","Data":"b829002a54f7b5371a25b9e775f04c2acccf3e10313be0cb598b3243e18ebb99"}
Jul 22 21:06:05.347484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:05.347437    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkb65" podStartSLOduration=14.929312138 podStartE2EDuration="26.347422806s" totalImagesPullingTime="11.418110668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:05.347097226 +0000 UTC m=+26.684712104" watchObservedRunningTime="2026-07-22 21:06:05.347422806 +0000 UTC m=+26.685037685"
Jul 22 21:06:06.145272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:06.145237    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:06.145428 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:06.145367    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:07.145264 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:07.145228    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:07.145828 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:07.145359    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:07.145828 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:07.145409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:07.145828 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:07.145513    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:08.145045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.144859    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:08.145368 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:08.145152    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:08.218333 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.218284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:08.324444 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.324404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:08.333935 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.333911    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:06:08.334318 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.334301    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"166946d01d6b027ae39fb1462f130a035988f1c3b52463872b5fbc1720d1c74a"}
Jul 22 21:06:08.334646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.334625    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:08.334770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.334692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:08.334770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.334746    2569 scope.go:117] "RemoveContainer" containerID="930d21cc135b38607b9b8fc1b109bbb13047b309a7bb5f7426b716cbe9f7a19e"
Jul 22 21:06:08.336050 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.336026    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="b89516a243f38b657eef4257a2ad642efab759807ca79d685669324629ed765a" exitCode=0
Jul 22 21:06:08.336168 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.336063    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"b89516a243f38b657eef4257a2ad642efab759807ca79d685669324629ed765a"}
Jul 22 21:06:08.351664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.351643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:08.416450 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.416368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:08.667346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.667266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:08.766071 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.765954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:08.818785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:08.818747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:09.145972 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.145943    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:09.146568 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.146023    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:09.146568 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:09.146045    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:09.146568 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:09.146121    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:09.341817 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.341795    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:06:09.342207 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.342177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" event={"ID":"bbc491f2-9c18-4d74-973d-276eca48b2bc","Type":"ContainerStarted","Data":"4393c7f74bed5b0837d9e1e93f33e42c40f43ba92c7603d7bc6c16a33e64a012"}
Jul 22 21:06:09.342540 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.342523    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:09.363736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.363713    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:09.369562 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.369498    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9" podStartSLOduration=10.115395484 podStartE2EDuration="30.369476673s" totalImagesPullingTime="20.254081189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:09.367587181 +0000 UTC m=+30.705202059" watchObservedRunningTime="2026-07-22 21:06:09.369476673 +0000 UTC m=+30.707091553"
Jul 22 21:06:09.662412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.662378    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:09.693039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.692956    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwpsw"]
Jul 22 21:06:09.693180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.693121    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:09.693242 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:09.693223    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:09.695537 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.695511    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mhxx"]
Jul 22 21:06:09.695672 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.695625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:09.695738 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:09.695707    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:09.696167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.696145    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7shg"]
Jul 22 21:06:09.696261 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.696252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:09.696382 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:09.696342    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:09.761113 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:09.761079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:10.346722 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:10.346690    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="38d9898f628b035f2ab809ba9004c82a8feeffd084f590cd3b0d83db8b5c793d" exitCode=0
Jul 22 21:06:10.347184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:10.346777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"38d9898f628b035f2ab809ba9004c82a8feeffd084f590cd3b0d83db8b5c793d"}
Jul 22 21:06:11.144971 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:11.144751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:11.145093 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:11.144806    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:11.145167 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:11.145104    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:11.145229 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:11.145182    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:11.351687 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:11.351655    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerStarted","Data":"866ad761886c6ffec56cbe1f1f50eeb30eda5fc9f53c22bb027678a9e05c6aad"}
Jul 22 21:06:11.442427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:11.442402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:11.501741 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:11.501718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:12.145283 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.145257    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:12.145446 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.145345    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:12.356350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.356321    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="866ad761886c6ffec56cbe1f1f50eeb30eda5fc9f53c22bb027678a9e05c6aad" exitCode=0
Jul 22 21:06:12.356709 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.356363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"866ad761886c6ffec56cbe1f1f50eeb30eda5fc9f53c22bb027678a9e05c6aad"}
Jul 22 21:06:12.795975 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.795944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:12.796145 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.795984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:12.796145 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.796085    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:06:12.796145 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.796098    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:06:12.796270 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.796158    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:44.796120122 +0000 UTC m=+66.133734980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:06:12.796270 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.796178    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret podName:08e931fb-ee7a-4868-af7f-30b6901e8b9c nodeName:}" failed. No retries permitted until 2026-07-22 21:06:44.796167869 +0000 UTC m=+66.133782730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret") pod "global-pull-secret-syncer-xwpsw" (UID: "08e931fb-ee7a-4868-af7f-30b6901e8b9c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:06:12.997441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:12.997407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:12.997589 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.997545    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:06:12.997589 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.997559    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:06:12.997589 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.997569    2569 projected.go:196] Error preparing data for projected volume kube-api-access-fnnfb for pod openshift-network-diagnostics/network-check-target-4mhxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:06:12.997714 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:12.997615    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb podName:1b131626-93cb-4a48-906d-e5b31acdc768 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:44.997601574 +0000 UTC m=+66.335216430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnnfb" (UniqueName: "kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb") pod "network-check-target-4mhxx" (UID: "1b131626-93cb-4a48-906d-e5b31acdc768") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:06:13.145151 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:13.145068    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:13.145281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:13.145072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:13.145281 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:13.145200    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:06:13.145386 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:13.145275    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwpsw" podUID="08e931fb-ee7a-4868-af7f-30b6901e8b9c"
Jul 22 21:06:14.144866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:14.144825    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:14.145253 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:14.144931    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mhxx" podUID="1b131626-93cb-4a48-906d-e5b31acdc768"
Jul 22 21:06:15.010858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.010825    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-246.ec2.internal" event="NodeReady"
Jul 22 21:06:15.010990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.010961    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 21:06:15.085731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.084616    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j7wnh"]
Jul 22 21:06:15.087697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.087661    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27q68"]
Jul 22 21:06:15.087822 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.087803    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.089498 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.089478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.091090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.091069    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 21:06:15.091266 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.091079    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2svwz\""
Jul 22 21:06:15.091266 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.091177    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 21:06:15.093087 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.092914    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 21:06:15.093087 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.092930    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 21:06:15.093655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.093633    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 21:06:15.097154 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.096855    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dq9z\""
Jul 22 21:06:15.109373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.109339    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27q68"]
Jul 22 21:06:15.110215 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.110194    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j7wnh"]
Jul 22 21:06:15.144858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.144839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:15.145054 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.145018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:15.147490 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.147474    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 21:06:15.147583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.147496    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 21:06:15.147583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.147497    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8629h\""
Jul 22 21:06:15.212168 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.212267 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-cert\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.212316 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1da27dcc-5799-4f36-9bd3-614d7b4377d2-config-volume\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.212316 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5qjn\" (UniqueName: \"kubernetes.io/projected/1da27dcc-5799-4f36-9bd3-614d7b4377d2-kube-api-access-x5qjn\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.212386 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk2d5\" (UniqueName: \"kubernetes.io/projected/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-kube-api-access-hk2d5\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.212426 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.212389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1da27dcc-5799-4f36-9bd3-614d7b4377d2-tmp-dir\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.245045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.245022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:15.313235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1da27dcc-5799-4f36-9bd3-614d7b4377d2-config-volume\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.313345 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5qjn\" (UniqueName: \"kubernetes.io/projected/1da27dcc-5799-4f36-9bd3-614d7b4377d2-kube-api-access-x5qjn\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.313345 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk2d5\" (UniqueName: \"kubernetes.io/projected/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-kube-api-access-hk2d5\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.313447 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1da27dcc-5799-4f36-9bd3-614d7b4377d2-tmp-dir\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.313502 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.313554 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-cert\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.313624 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:15.313605    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:15.313677 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:15.313664    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:15.81364776 +0000 UTC m=+37.151262619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:15.313881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1da27dcc-5799-4f36-9bd3-614d7b4377d2-tmp-dir\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.313881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.313869    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1da27dcc-5799-4f36-9bd3-614d7b4377d2-config-volume\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.318463 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.318444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-cert\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.321659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.321639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5qjn\" (UniqueName: \"kubernetes.io/projected/1da27dcc-5799-4f36-9bd3-614d7b4377d2-kube-api-access-x5qjn\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.322082 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.322065    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk2d5\" (UniqueName: \"kubernetes.io/projected/ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed-kube-api-access-hk2d5\") pod \"ingress-canary-27q68\" (UID: \"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed\") " pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.406000 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.405976    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27q68"
Jul 22 21:06:15.547924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.547753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27q68"]
Jul 22 21:06:15.553034 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:06:15.553005    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad02ba68_aa15_4b89_8dbf_8b0e4d7cc1ed.slice/crio-20ceff8cb721e78bd602667bd1cc5005d96c63eda3aa1e88a9212d2dca1355e7 WatchSource:0}: Error finding container 20ceff8cb721e78bd602667bd1cc5005d96c63eda3aa1e88a9212d2dca1355e7: Status 404 returned error can't find the container with id 20ceff8cb721e78bd602667bd1cc5005d96c63eda3aa1e88a9212d2dca1355e7
Jul 22 21:06:15.817776 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:15.817746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:15.817957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:15.817869    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:15.817957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:15.817935    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:16.817918856 +0000 UTC m=+38.155533714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:16.145161 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.145069    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:16.148285 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.148255    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 21:06:16.149311 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.149295    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2zj6\""
Jul 22 21:06:16.149407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.149349    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 21:06:16.367204 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.367171    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27q68" event={"ID":"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed","Type":"ContainerStarted","Data":"20ceff8cb721e78bd602667bd1cc5005d96c63eda3aa1e88a9212d2dca1355e7"}
Jul 22 21:06:16.825211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:16.825182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:16.825416 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:16.825332    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:16.825416 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:16.825410    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:18.825389543 +0000 UTC m=+40.163004402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:18.839427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:18.839393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:18.839697 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:18.839549    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:18.839697 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:18.839613    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:22.839596874 +0000 UTC m=+44.177211730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:18.869513 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:18.869481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:18.957333 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:18.957303    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:19.378749 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:19.378679    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="58ee5657b4d6be4bf09d4d59c612f5299b28fb4dd2b3a84d1c9236ce54e8ea5f" exitCode=0
Jul 22 21:06:19.378879 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:19.378752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"58ee5657b4d6be4bf09d4d59c612f5299b28fb4dd2b3a84d1c9236ce54e8ea5f"}
Jul 22 21:06:19.380120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:19.380099    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27q68" event={"ID":"ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed","Type":"ContainerStarted","Data":"fe4975dba69b694f5e3e140e0c327fd28b5ceb6448fc4651ea1e969454e5a631"}
Jul 22 21:06:19.415568 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:19.415530    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27q68" podStartSLOduration=1.003049486 podStartE2EDuration="4.415516357s" totalImagesPullingTime="3.412466871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:19.414938037 +0000 UTC m=+40.752552915" watchObservedRunningTime="2026-07-22 21:06:19.415516357 +0000 UTC m=+40.753131226"
Jul 22 21:06:20.389402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:20.389362    2569 generic.go:356] "Generic (PLEG): container finished" podID="0df5b237-8912-4810-8fcb-30b1df5f55a4" containerID="79c2d9d6dfb1d83d8d13316e48790fd171056fc27aa105cc0c73879815dfcfc8" exitCode=0
Jul 22 21:06:20.389881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:20.389452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerDied","Data":"79c2d9d6dfb1d83d8d13316e48790fd171056fc27aa105cc0c73879815dfcfc8"}
Jul 22 21:06:20.897434 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:20.897405    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:21.395595 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:21.395567    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" event={"ID":"0df5b237-8912-4810-8fcb-30b1df5f55a4","Type":"ContainerStarted","Data":"8e213ee1414dec9a2cedee3f9d3a4007cce85f36e4ebf396f804933f972637c0"}
Jul 22 21:06:21.418024 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:21.417971    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fzcmc" podStartSLOduration=8.703147524 podStartE2EDuration="42.417950305s" totalImagesPullingTime="33.714802781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:21.417804279 +0000 UTC m=+42.755419159" watchObservedRunningTime="2026-07-22 21:06:21.417950305 +0000 UTC m=+42.755565183"
Jul 22 21:06:21.539072 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:21.539046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:21.590401 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:21.590383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:22.866396 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:22.866361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:22.866840 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:22.866495    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:22.866840 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:22.866569    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:30.866548366 +0000 UTC m=+52.204163227 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:24.737560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:24.737528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:24.790855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:24.790826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:25.192029 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:25.191948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:25.254736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:25.254707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:25.369708 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:25.369680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:25.422781 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:25.422755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:30.921338 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:30.921303    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:30.921735 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:30.921453    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:30.921735 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:30.921518    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:46.921501402 +0000 UTC m=+68.259116258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:41.362953 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:41.362924    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n7rl9"
Jul 22 21:06:41.511478 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:41.511439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:41.575887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:41.575855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:44.817716 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.817678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:44.817716 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.817722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:06:44.823256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.823227    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 21:06:44.823376 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.823227    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 21:06:44.828353 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:44.828331    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:06:44.828464 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:44.828435    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:07:48.828410884 +0000 UTC m=+130.166025747 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : secret "metrics-daemon-secret" not found
Jul 22 21:06:44.831916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.831884    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08e931fb-ee7a-4868-af7f-30b6901e8b9c-original-pull-secret\") pod \"global-pull-secret-syncer-xwpsw\" (UID: \"08e931fb-ee7a-4868-af7f-30b6901e8b9c\") " pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:44.862053 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.862027    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwpsw"
Jul 22 21:06:44.982146 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:44.982104    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwpsw"]
Jul 22 21:06:44.986144 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:06:44.986103    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e931fb_ee7a_4868_af7f_30b6901e8b9c.slice/crio-5d3ce0334596d49021c57c56e6273d0dddf7e97367c034b52a4f94542dc3c625 WatchSource:0}: Error finding container 5d3ce0334596d49021c57c56e6273d0dddf7e97367c034b52a4f94542dc3c625: Status 404 returned error can't find the container with id 5d3ce0334596d49021c57c56e6273d0dddf7e97367c034b52a4f94542dc3c625
Jul 22 21:06:45.018818 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.018791    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:45.021262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.021244    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 21:06:45.031305 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.031289    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 21:06:45.042542 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.042520    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnnfb\" (UniqueName: \"kubernetes.io/projected/1b131626-93cb-4a48-906d-e5b31acdc768-kube-api-access-fnnfb\") pod \"network-check-target-4mhxx\" (UID: \"1b131626-93cb-4a48-906d-e5b31acdc768\") " pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:45.259860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.259838    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2zj6\""
Jul 22 21:06:45.268174 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.268154    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:45.388408 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.388380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mhxx"]
Jul 22 21:06:45.391486 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:06:45.391463    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b131626_93cb_4a48_906d_e5b31acdc768.slice/crio-ed83d673c7711151f9532d6f3a420660359644d1e933207584f31e09d1bb528a WatchSource:0}: Error finding container ed83d673c7711151f9532d6f3a420660359644d1e933207584f31e09d1bb528a: Status 404 returned error can't find the container with id ed83d673c7711151f9532d6f3a420660359644d1e933207584f31e09d1bb528a
Jul 22 21:06:45.454928 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.454897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mhxx" event={"ID":"1b131626-93cb-4a48-906d-e5b31acdc768","Type":"ContainerStarted","Data":"ed83d673c7711151f9532d6f3a420660359644d1e933207584f31e09d1bb528a"}
Jul 22 21:06:45.456196 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:45.456169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwpsw" event={"ID":"08e931fb-ee7a-4868-af7f-30b6901e8b9c","Type":"ContainerStarted","Data":"5d3ce0334596d49021c57c56e6273d0dddf7e97367c034b52a4f94542dc3c625"}
Jul 22 21:06:46.697752 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:46.697689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:46.798320 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:46.798284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:06:46.934524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:46.934491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:06:46.934701 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:46.934680    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:46.934776 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:06:46.934765    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:07:18.93474333 +0000 UTC m=+100.272358193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:47.427644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.426723    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"]
Jul 22 21:06:47.429946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.429924    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.432358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.432332    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 21:06:47.432521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.432507    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 21:06:47.433538 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.433515    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 21:06:47.433639 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.433516    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 21:06:47.437748 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.437723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zkrz\" (UniqueName: \"kubernetes.io/projected/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-kube-api-access-7zkrz\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.437856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.437795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-tmp\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.438265 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.437864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-klusterlet-config\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.439650 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.439599    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"]
Jul 22 21:06:47.451208 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.451185    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"]
Jul 22 21:06:47.453744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.453375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.456092 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.456073    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 21:06:47.456211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.456165    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 21:06:47.456211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.456207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 21:06:47.456594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.456442    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 21:06:47.465416 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.465394    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"]
Jul 22 21:06:47.539055 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-tmp\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.539226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-klusterlet-config\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.539226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539106    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2494bf-f07c-486b-849f-dfb598b9e339-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539442 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539442 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zkrz\" (UniqueName: \"kubernetes.io/projected/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-kube-api-access-7zkrz\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.539442 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539442 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zt7x\" (UniqueName: \"kubernetes.io/projected/8b2494bf-f07c-486b-849f-dfb598b9e339-kube-api-access-5zt7x\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.539741 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.539714    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-tmp\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.542971 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.542950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-klusterlet-config\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.549484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.549464    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zkrz\" (UniqueName: \"kubernetes.io/projected/5a2b2619-6267-42b5-a5c7-d6da5a2858b2-kube-api-access-7zkrz\") pod \"klusterlet-addon-workmgr-866558cb68-8twnj\" (UID: \"5a2b2619-6267-42b5-a5c7-d6da5a2858b2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.640490 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.640616 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2494bf-f07c-486b-849f-dfb598b9e339-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.640616 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.640616 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640565    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.640616 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.640744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.640623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zt7x\" (UniqueName: \"kubernetes.io/projected/8b2494bf-f07c-486b-849f-dfb598b9e339-kube-api-access-5zt7x\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.642016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.641987    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b2494bf-f07c-486b-849f-dfb598b9e339-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.643946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.643927    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.644071 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.644050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.644346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.644327    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-ca\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.645211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.645192    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b2494bf-f07c-486b-849f-dfb598b9e339-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.649850 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.649828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zt7x\" (UniqueName: \"kubernetes.io/projected/8b2494bf-f07c-486b-849f-dfb598b9e339-kube-api-access-5zt7x\") pod \"cluster-proxy-proxy-agent-846495fcdc-xk7ws\" (UID: \"8b2494bf-f07c-486b-849f-dfb598b9e339\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:47.741990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.741816    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:47.771589 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:47.771566    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:06:49.864282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:49.864256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"]
Jul 22 21:06:49.867262 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:06:49.867235    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b2494bf_f07c_486b_849f_dfb598b9e339.slice/crio-39e3ae8a34515e9a1e419e5d1f8c26ff1bc9e8d63855157fad1694fb3bdf7384 WatchSource:0}: Error finding container 39e3ae8a34515e9a1e419e5d1f8c26ff1bc9e8d63855157fad1694fb3bdf7384: Status 404 returned error can't find the container with id 39e3ae8a34515e9a1e419e5d1f8c26ff1bc9e8d63855157fad1694fb3bdf7384
Jul 22 21:06:49.873810 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:49.873789    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"]
Jul 22 21:06:50.475297 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.475257    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mhxx" event={"ID":"1b131626-93cb-4a48-906d-e5b31acdc768","Type":"ContainerStarted","Data":"1c492c8656e39f12a8b9c7601451c6efdcb7b2f6441c75aacb8fe1563b19b9fd"}
Jul 22 21:06:50.475497 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.475319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:06:50.476607 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.476579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwpsw" event={"ID":"08e931fb-ee7a-4868-af7f-30b6901e8b9c","Type":"ContainerStarted","Data":"527ce9a7b55dd0c62ccafed4a8d37c7b755550984e6de246d609396a0f3949a5"}
Jul 22 21:06:50.477753 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.477733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" event={"ID":"5a2b2619-6267-42b5-a5c7-d6da5a2858b2","Type":"ContainerStarted","Data":"932057c78679c940d9963845af5db663b85984ce0fa188baebec0837d0c64f30"}
Jul 22 21:06:50.478652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.478629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerStarted","Data":"39e3ae8a34515e9a1e419e5d1f8c26ff1bc9e8d63855157fad1694fb3bdf7384"}
Jul 22 21:06:50.491351 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.491311    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4mhxx" podStartSLOduration=67.168530305 podStartE2EDuration="1m11.491297755s" totalImagesPullingTime="4.32276745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:50.490196359 +0000 UTC m=+71.827811230" watchObservedRunningTime="2026-07-22 21:06:50.491297755 +0000 UTC m=+71.828912657"
Jul 22 21:06:50.503979 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:50.503942    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xwpsw" podStartSLOduration=66.768907892 podStartE2EDuration="1m11.503933388s" totalImagesPullingTime="4.735025496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:50.503486547 +0000 UTC m=+71.841101430" watchObservedRunningTime="2026-07-22 21:06:50.503933388 +0000 UTC m=+71.841548265"
Jul 22 21:06:55.496928 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.496855    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" event={"ID":"5a2b2619-6267-42b5-a5c7-d6da5a2858b2","Type":"ContainerStarted","Data":"8df30b8ebb31851ef240374b7b8349a4123a14ba6990225e97791a15ac39521d"}
Jul 22 21:06:55.497332 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.496953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:55.498742 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.498721    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:06:55.499367 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.499344    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerStarted","Data":"c4a8fb7fbbc75625b60f8f529f275056bc612064f637a2fdb602c0a151881c4f"}
Jul 22 21:06:55.499455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.499377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerStarted","Data":"9a065634cb141d682050f3e377ac3410a8e91b34d6249869dabb2f8265bd5d37"}
Jul 22 21:06:55.499455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.499388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerStarted","Data":"b664c836459287643e577247c711c9231c81a4f860f87f668399512906784c23"}
Jul 22 21:06:55.515183 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.515115    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" podStartSLOduration=3.147360065 podStartE2EDuration="8.515023071s" totalImagesPullingTime="5.367663006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:55.514614911 +0000 UTC m=+76.852229789" watchObservedRunningTime="2026-07-22 21:06:55.515023071 +0000 UTC m=+76.852637947"
Jul 22 21:06:55.534562 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:06:55.534518    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" podStartSLOduration=3.155734591 podStartE2EDuration="8.534506194s" totalImagesPullingTime="5.378771603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:55.533762349 +0000 UTC m=+76.871377227" watchObservedRunningTime="2026-07-22 21:06:55.534506194 +0000 UTC m=+76.872121072"
Jul 22 21:07:10.029475 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:07:10.029341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:07:10.089887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:07:10.089857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:07:18.959826 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:07:18.959775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:07:18.960289 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:07:18.959936    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:07:18.960289 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:07:18.960007    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:08:22.95999015 +0000 UTC m=+164.297605010 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:07:21.485780 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:07:21.485750    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4mhxx"
Jul 22 21:07:48.851847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:07:48.851813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:07:48.852284 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:07:48.851929    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:07:48.852284 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:07:48.852005    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:09:50.851986926 +0000 UTC m=+252.189601784 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : secret "metrics-daemon-secret" not found
Jul 22 21:08:18.100546 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:08:18.100498    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j7wnh" podUID="1da27dcc-5799-4f36-9bd3-614d7b4377d2"
Jul 22 21:08:18.155804 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:08:18.155763    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:08:18.731519 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:18.731493    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:08:22.973395 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:22.973358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:08:22.973811 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:08:22.973474    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:08:22.973811 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:08:22.973533    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls podName:1da27dcc-5799-4f36-9bd3-614d7b4377d2 nodeName:}" failed. No retries permitted until 2026-07-22 21:10:24.973520383 +0000 UTC m=+286.311135239 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls") pod "dns-default-j7wnh" (UID: "1da27dcc-5799-4f36-9bd3-614d7b4377d2") : secret "dns-default-metrics-tls" not found
Jul 22 21:08:31.145253 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:31.145170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:08:55.497662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:55.497611    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" podUID="5a2b2619-6267-42b5-a5c7-d6da5a2858b2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 22 21:08:55.834376 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:55.834344    2569 generic.go:356] "Generic (PLEG): container finished" podID="5a2b2619-6267-42b5-a5c7-d6da5a2858b2" containerID="8df30b8ebb31851ef240374b7b8349a4123a14ba6990225e97791a15ac39521d" exitCode=1
Jul 22 21:08:55.834536 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:55.834396    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" event={"ID":"5a2b2619-6267-42b5-a5c7-d6da5a2858b2","Type":"ContainerDied","Data":"8df30b8ebb31851ef240374b7b8349a4123a14ba6990225e97791a15ac39521d"}
Jul 22 21:08:55.834744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:55.834719    2569 scope.go:117] "RemoveContainer" containerID="8df30b8ebb31851ef240374b7b8349a4123a14ba6990225e97791a15ac39521d"
Jul 22 21:08:56.838933 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:56.838901    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj" event={"ID":"5a2b2619-6267-42b5-a5c7-d6da5a2858b2","Type":"ContainerStarted","Data":"65f633ca8dac837935b37fc62de9f698367c9817da48303d5b251f0f5eadebfe"}
Jul 22 21:08:56.839351 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:56.839263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:08:56.839873 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:08:56.839850    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866558cb68-8twnj"
Jul 22 21:09:20.116940 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:20.116902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:49.074466 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:49.074430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:49.174586 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:49.174530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:50.867012 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:50.866967    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:09:50.867432 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:50.867079    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:09:50.867432 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:50.867185    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs podName:7a76272e-c625-4fe9-9a9c-bd16bf90c930 nodeName:}" failed. No retries permitted until 2026-07-22 21:11:52.867153025 +0000 UTC m=+374.204767895 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs") pod "network-metrics-daemon-z7shg" (UID: "7a76272e-c625-4fe9-9a9c-bd16bf90c930") : secret "metrics-daemon-secret" not found
Jul 22 21:09:51.191675 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:51.191586    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:51.248071 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:51.248039    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:53.947909 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:53.947874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:54.020648 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.020612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:54.399019 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.398988    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-94qnv"]
Jul 22 21:09:54.401189 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.401169    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.403492 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.403469    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 21:09:54.404516 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.404491    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 21:09:54.404516 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.404502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 21:09:54.404771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.404538    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f4mgb\""
Jul 22 21:09:54.404771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.404501    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 21:09:54.414571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.414552    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-94qnv"]
Jul 22 21:09:54.432898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.432865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:54.493046 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.493009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36242283-0c7a-496f-946b-f9b0d798a2af-crio-socket\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.493046 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.493046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcvjg\" (UniqueName: \"kubernetes.io/projected/36242283-0c7a-496f-946b-f9b0d798a2af-kube-api-access-vcvjg\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.493286 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.493080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.493286 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.493143    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36242283-0c7a-496f-946b-f9b0d798a2af-data-volume\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.493286 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.493211    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.498583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.498552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:54.593782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.593746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.593931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.593826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36242283-0c7a-496f-946b-f9b0d798a2af-crio-socket\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.593931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.593851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvjg\" (UniqueName: \"kubernetes.io/projected/36242283-0c7a-496f-946b-f9b0d798a2af-kube-api-access-vcvjg\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.593931 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:54.593887    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:54.593953    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:54.593968    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:55.093947906 +0000 UTC m=+256.431562764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.593890    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:54.594015    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:55.09399864 +0000 UTC m=+256.431613513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.593951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36242283-0c7a-496f-946b-f9b0d798a2af-crio-socket\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.594083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.594049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36242283-0c7a-496f-946b-f9b0d798a2af-data-volume\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.594451 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.594422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36242283-0c7a-496f-946b-f9b0d798a2af-data-volume\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.604272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.604246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvjg\" (UniqueName: \"kubernetes.io/projected/36242283-0c7a-496f-946b-f9b0d798a2af-kube-api-access-vcvjg\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:54.907472 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.907433    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:54.958440 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:54.958399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:55.097571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:55.097531    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:55.097742 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:55.097595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:55.097742 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:55.097670    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:55.097742 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:55.097688    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:55.097742 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:55.097719    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:56.097706812 +0000 UTC m=+257.435321668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:55.097873 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:55.097753    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:56.09773886 +0000 UTC m=+257.435353716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:55.170410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:55.170325    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:55.269757 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:55.269719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:56.105235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:56.105186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:56.105641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:56.105264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:56.105641 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:56.105334    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:56.105641 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:56.105352    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:56.105641 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:56.105385    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:58.105372221 +0000 UTC m=+259.442987081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:56.105641 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:56.105411    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:09:58.105398189 +0000 UTC m=+259.443013044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:56.387724 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:56.387647    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w76cl_ea6ceeb0-3728-40fa-a2ac-3e584cf079b8/dns-node-resolver/0.log"
Jul 22 21:09:56.805578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:56.805549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:56.863428 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:56.863398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:57.388946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:57.388913    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjb5g_4fe7ad62-5387-4b4c-a773-a9144974a8a0/node-ca/0.log"
Jul 22 21:09:57.907985 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:57.907951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:57.988725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:57.988695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27q68_ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed/serve-healthcheck-canary/0.log"
Jul 22 21:09:58.118415 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.118380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:58.118567 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.118444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:09:58.118567 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:58.118501    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:58.118567 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:58.118551    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:58.118567 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:58.118564    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:10:02.118548385 +0000 UTC m=+263.456163241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:58.118723 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:09:58.118592    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:10:02.118580783 +0000 UTC m=+263.456195638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:58.454514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.454484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:58.604838 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.604811    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:58.705111 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.705035    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:58.805446 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.805424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:58.873085 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.873061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:58.967392 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:58.967322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:09:59.145611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:09:59.145578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:00.144612 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:00.144527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:00.208737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:00.208707    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:00.338928 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:00.338897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:00.535962 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:00.535931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:00.955690 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:00.955612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:01.551546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:01.551513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:01.984674 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:01.984645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:02.147509 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.147483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:02.147662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.147535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:02.147662 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:02.147594    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:10:02.147662 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:02.147626    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:10:02.147662 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:02.147649    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:10:10.147637006 +0000 UTC m=+271.485251861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : configmap "kube-rbac-proxy" not found
Jul 22 21:10:02.147839 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:02.147671    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls podName:36242283-0c7a-496f-946b-f9b0d798a2af nodeName:}" failed. No retries permitted until 2026-07-22 21:10:10.147659619 +0000 UTC m=+271.485274474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-94qnv" (UID: "36242283-0c7a-496f-946b-f9b0d798a2af") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:10:02.257524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.257462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:02.502611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.502583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:02.622525 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.622435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:02.736208 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.736175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:02.934556 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:02.934468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:03.555022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:03.554984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:04.139005 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:04.138978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:04.657560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:04.657523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:04.758881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:04.758845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:04.861973 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:04.861945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:04.962923 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:04.962844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:05.134929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:05.134905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:06.135599 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:06.135555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:06.337169 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:06.337111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:06.738384 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:06.738348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:06.932871 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:06.932840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:07.094992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:07.094877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:07.346933 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:07.346848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:08.151054 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:08.151017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:08.533641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:08.533601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:08.719792 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:08.719749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:08.773181 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:08.773146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:08.993762 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:08.993733    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:09.137734 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:09.137701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:10.205900 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.205866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:10.206335 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.205925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:10.206435 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.206415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36242283-0c7a-496f-946b-f9b0d798a2af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:10.208623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.208604    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36242283-0c7a-496f-946b-f9b0d798a2af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-94qnv\" (UID: \"36242283-0c7a-496f-946b-f9b0d798a2af\") " pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:10.309769 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.309741    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-94qnv"
Jul 22 21:10:10.442447 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:10.442418    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-94qnv"]
Jul 22 21:10:10.445534 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:10:10.445504    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36242283_0c7a_496f_946b_f9b0d798a2af.slice/crio-a5573e7093db5822527768cb8a9b4d563b9c77edae125a73b1e3571626ca8f61 WatchSource:0}: Error finding container a5573e7093db5822527768cb8a9b4d563b9c77edae125a73b1e3571626ca8f61: Status 404 returned error can't find the container with id a5573e7093db5822527768cb8a9b4d563b9c77edae125a73b1e3571626ca8f61
Jul 22 21:10:11.052978 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.052933    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94qnv" event={"ID":"36242283-0c7a-496f-946b-f9b0d798a2af","Type":"ContainerStarted","Data":"a5573e7093db5822527768cb8a9b4d563b9c77edae125a73b1e3571626ca8f61"}
Jul 22 21:10:11.329725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.329531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:11.380005 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.379928    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:11.709766 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.709667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:11.764541 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.764511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:11.947893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.947859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:11.999993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:11.999954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:12.534946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:12.534886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:12.760963 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:12.760924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:13.454250 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:13.454215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:16.073311 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:16.073226    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94qnv" event={"ID":"36242283-0c7a-496f-946b-f9b0d798a2af","Type":"ContainerStarted","Data":"a2cbe67a6c352ef3f016b353b455aaa3538d0cf2a02d4800f7594aa1b0555af4"}
Jul 22 21:10:18.173312 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.173269    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-b7smb"]
Jul 22 21:10:18.190622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.190594    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-b7smb"]
Jul 22 21:10:18.190759 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.190706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:18.193895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.193854    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 21:10:18.194056 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.193861    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 21:10:18.194242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.194226    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4f858\""
Jul 22 21:10:18.216551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.216525    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5744b9cc-s6n48"]
Jul 22 21:10:18.219190 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.219171    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.221728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.221709    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 21:10:18.221827 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.221775    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 21:10:18.221827 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.221817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7thd2\""
Jul 22 21:10:18.221928 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.221824    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 21:10:18.231368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.231346    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 21:10:18.234089 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.234060    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5744b9cc-s6n48"]
Jul 22 21:10:18.252166 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.252109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:18.353387 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.353351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:18.365303 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-trusted-ca\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365438 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-image-registry-private-configuration\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365438 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-bound-sa-token\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365438 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-certificates\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365467    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvrf\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-kube-api-access-frvrf\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-installation-pull-secrets\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365643 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgj5j\" (UniqueName: \"kubernetes.io/projected/e85294ab-9314-41b2-9f2a-de23aabf60f8-kube-api-access-jgj5j\") pod \"downloads-5bc67dcd46-b7smb\" (UID: \"e85294ab-9314-41b2-9f2a-de23aabf60f8\") " pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:18.365643 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15afd7b-c744-41ea-ae94-2b50037e0488-ca-trust-extracted\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.365643 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.365630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-tls\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvrf\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-kube-api-access-frvrf\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466381    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-installation-pull-secrets\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgj5j\" (UniqueName: \"kubernetes.io/projected/e85294ab-9314-41b2-9f2a-de23aabf60f8-kube-api-access-jgj5j\") pod \"downloads-5bc67dcd46-b7smb\" (UID: \"e85294ab-9314-41b2-9f2a-de23aabf60f8\") " pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:18.466640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15afd7b-c744-41ea-ae94-2b50037e0488-ca-trust-extracted\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466750 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-tls\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466750 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-trusted-ca\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466750 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-image-registry-private-configuration\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-bound-sa-token\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-certificates\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.466901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.466829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e15afd7b-c744-41ea-ae94-2b50037e0488-ca-trust-extracted\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.467877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.467851    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-trusted-ca\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.468103 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.468070    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-certificates\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.469473 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.469420    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-installation-pull-secrets\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.469617 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.469590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-registry-tls\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.469729 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.469712    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e15afd7b-c744-41ea-ae94-2b50037e0488-image-registry-private-configuration\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.470891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.470865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:18.475790 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.475768    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvrf\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-kube-api-access-frvrf\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.478754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.478732    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e15afd7b-c744-41ea-ae94-2b50037e0488-bound-sa-token\") pod \"image-registry-5744b9cc-s6n48\" (UID: \"e15afd7b-c744-41ea-ae94-2b50037e0488\") " pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:18.479027 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.479010    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgj5j\" (UniqueName: \"kubernetes.io/projected/e85294ab-9314-41b2-9f2a-de23aabf60f8-kube-api-access-jgj5j\") pod \"downloads-5bc67dcd46-b7smb\" (UID: \"e85294ab-9314-41b2-9f2a-de23aabf60f8\") " pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:18.498989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.498966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:18.532335 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:18.532310    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:19.018178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.018114    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-b7smb"]
Jul 22 21:10:19.020432 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:10:19.020407    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85294ab_9314_41b2_9f2a_de23aabf60f8.slice/crio-62e4c75bdcd235410738dacbf70d2fd95e24d6ad3fd5e20e144c88d949f35804 WatchSource:0}: Error finding container 62e4c75bdcd235410738dacbf70d2fd95e24d6ad3fd5e20e144c88d949f35804: Status 404 returned error can't find the container with id 62e4c75bdcd235410738dacbf70d2fd95e24d6ad3fd5e20e144c88d949f35804
Jul 22 21:10:19.033110 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.033086    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5744b9cc-s6n48"]
Jul 22 21:10:19.035570 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:10:19.035546    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15afd7b_c744_41ea_ae94_2b50037e0488.slice/crio-9ac0c76e8c84adba9561ce4c301223966c3411e2baf38b6b0288f1ad3172fd75 WatchSource:0}: Error finding container 9ac0c76e8c84adba9561ce4c301223966c3411e2baf38b6b0288f1ad3172fd75: Status 404 returned error can't find the container with id 9ac0c76e8c84adba9561ce4c301223966c3411e2baf38b6b0288f1ad3172fd75
Jul 22 21:10:19.084648 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.084620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94qnv" event={"ID":"36242283-0c7a-496f-946b-f9b0d798a2af","Type":"ContainerStarted","Data":"d6236bae4aa7052f9a6a944efd81a7df15e3001dbe54d1d17641b3a72c809372"}
Jul 22 21:10:19.085762 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.085725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-b7smb" event={"ID":"e85294ab-9314-41b2-9f2a-de23aabf60f8","Type":"ContainerStarted","Data":"62e4c75bdcd235410738dacbf70d2fd95e24d6ad3fd5e20e144c88d949f35804"}
Jul 22 21:10:19.087063 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.087044    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5744b9cc-s6n48" event={"ID":"e15afd7b-c744-41ea-ae94-2b50037e0488","Type":"ContainerStarted","Data":"9ac0c76e8c84adba9561ce4c301223966c3411e2baf38b6b0288f1ad3172fd75"}
Jul 22 21:10:19.087190 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.087177    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:19.106503 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:19.106466    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5744b9cc-s6n48" podStartSLOduration=1.1064445 podStartE2EDuration="1.1064445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:19.106116808 +0000 UTC m=+280.443731686" watchObservedRunningTime="2026-07-22 21:10:19.1064445 +0000 UTC m=+280.444059378"
Jul 22 21:10:20.091185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:20.091148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5744b9cc-s6n48" event={"ID":"e15afd7b-c744-41ea-ae94-2b50037e0488","Type":"ContainerStarted","Data":"af01cd6708cbcdff86873db207c96d253b5d2b2ce9cdbd6f7fe75ed3efa5b318"}
Jul 22 21:10:21.732568 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:21.732506    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j7wnh" podUID="1da27dcc-5799-4f36-9bd3-614d7b4377d2"
Jul 22 21:10:22.099105 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:22.099028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:22.153004 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:22.152954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:22.211427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:22.211392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:24.466876 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:24.466831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:24.567957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:24.567920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:24.634022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:24.633983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:24.857845 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:24.857757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:25.021251 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.021216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:25.023594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.023567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1da27dcc-5799-4f36-9bd3-614d7b4377d2-metrics-tls\") pod \"dns-default-j7wnh\" (UID: \"1da27dcc-5799-4f36-9bd3-614d7b4377d2\") " pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:25.102143 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.102102    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2svwz\""
Jul 22 21:10:25.110437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.110363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:25.113759 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.113732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-94qnv" event={"ID":"36242283-0c7a-496f-946b-f9b0d798a2af","Type":"ContainerStarted","Data":"2047aa1484a3011e78e9d282861a943eaf040cacaf321c3d33992e24f4d2b237"}
Jul 22 21:10:25.133099 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.132905    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-94qnv" podStartSLOduration=17.470337842 podStartE2EDuration="31.132885997s" totalImagesPullingTime="13.662548155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:09:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:25.130823387 +0000 UTC m=+286.468438266" watchObservedRunningTime="2026-07-22 21:10:25.132885997 +0000 UTC m=+286.470500872"
Jul 22 21:10:25.249904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:25.249823    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j7wnh"]
Jul 22 21:10:25.256042 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:10:25.256013    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da27dcc_5799_4f36_9bd3_614d7b4377d2.slice/crio-162fedeafcb68ce78e158ec873fc87948ef75285577ec3113134effad7f7d6ca WatchSource:0}: Error finding container 162fedeafcb68ce78e158ec873fc87948ef75285577ec3113134effad7f7d6ca: Status 404 returned error can't find the container with id 162fedeafcb68ce78e158ec873fc87948ef75285577ec3113134effad7f7d6ca
Jul 22 21:10:26.119694 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:26.119624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j7wnh" event={"ID":"1da27dcc-5799-4f36-9bd3-614d7b4377d2","Type":"ContainerStarted","Data":"162fedeafcb68ce78e158ec873fc87948ef75285577ec3113134effad7f7d6ca"}
Jul 22 21:10:26.158550 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:26.158504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:27.125783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:27.125707    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j7wnh" event={"ID":"1da27dcc-5799-4f36-9bd3-614d7b4377d2","Type":"ContainerStarted","Data":"a7032f14041ccf6c6c243ca22a8b45c3196a64959591e51ec84174fd5e4a9ecd"}
Jul 22 21:10:27.125783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:27.125791    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j7wnh" event={"ID":"1da27dcc-5799-4f36-9bd3-614d7b4377d2","Type":"ContainerStarted","Data":"26b84c9adbec5bdec22eb7f3eb754b0191cde3b42792d352011314a9fea9a7ff"}
Jul 22 21:10:27.126285 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:27.125898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:28.262899 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:28.262857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:28.666990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:28.666907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:28.762225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:28.762185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:29.623793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:29.623664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:30.902863 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:30.902824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:30.971149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:30.971096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:31.028937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:31.028899    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:31.422355 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:31.422314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:31.487883 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:31.487850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:32.355831 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:32.355797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:33.357396 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:33.357333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:33.458177 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:33.458118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:33.558637 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:33.558599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:34.145945 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:34.145905    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z7shg" podUID="7a76272e-c625-4fe9-9a9c-bd16bf90c930"
Jul 22 21:10:34.835594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:34.835555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.012609 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.012577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.076560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.076503    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j7wnh" podStartSLOduration=258.459850532 podStartE2EDuration="4m20.076484652s" totalImagesPullingTime="1.61663412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:27.142266693 +0000 UTC m=+288.479881763" watchObservedRunningTime="2026-07-22 21:10:35.076484652 +0000 UTC m=+296.414099530"
Jul 22 21:10:35.076726 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.076664    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zrvn5"]
Jul 22 21:10:35.081270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.081251    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.083848 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.083826    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 21:10:35.083979 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.083959    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 21:10:35.084342 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.084322    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 21:10:35.084522 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.084500    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbmlg\""
Jul 22 21:10:35.085086 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.085066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 21:10:35.085187 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.085161    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 21:10:35.085187 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.085179    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 21:10:35.105523 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105534    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-textfile\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcr8\" (UniqueName: \"kubernetes.io/projected/5eaddce2-e9fb-468e-916e-895583a9f2ac-kube-api-access-4wcr8\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-root\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105789 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-metrics-client-ca\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105789 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105789 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-sys\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.105929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.105824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-wtmp\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.116651 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.116610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.192324 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.192287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.206169 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-sys\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206207    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-sys\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-wtmp\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206358 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-textfile\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcr8\" (UniqueName: \"kubernetes.io/projected/5eaddce2-e9fb-468e-916e-895583a9f2ac-kube-api-access-4wcr8\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-root\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-wtmp\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-metrics-client-ca\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5eaddce2-e9fb-468e-916e-895583a9f2ac-root\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.206646 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:35.206601    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 21:10:35.206978 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:35.206668    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls podName:5eaddce2-e9fb-468e-916e-895583a9f2ac nodeName:}" failed. No retries permitted until 2026-07-22 21:10:35.706648179 +0000 UTC m=+297.044263035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls") pod "node-exporter-zrvn5" (UID: "5eaddce2-e9fb-468e-916e-895583a9f2ac") : secret "node-exporter-tls" not found
Jul 22 21:10:35.206978 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.206892    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-textfile\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.207086 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.207031    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.207216 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.207194    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5eaddce2-e9fb-468e-916e-895583a9f2ac-metrics-client-ca\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.209109 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.209089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.216541 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.216517    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcr8\" (UniqueName: \"kubernetes.io/projected/5eaddce2-e9fb-468e-916e-895583a9f2ac-kube-api-access-4wcr8\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.324123 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.324081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.426389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.426301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.580273 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.580226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.681143 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.681019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:35.711177 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.711146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:35.711355 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:35.711326    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 21:10:35.711417 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:10:35.711400    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls podName:5eaddce2-e9fb-468e-916e-895583a9f2ac nodeName:}" failed. No retries permitted until 2026-07-22 21:10:36.71137909 +0000 UTC m=+298.048993958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls") pod "node-exporter-zrvn5" (UID: "5eaddce2-e9fb-468e-916e-895583a9f2ac") : secret "node-exporter-tls" not found
Jul 22 21:10:35.809229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:35.809163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:36.014243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.014207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:36.087788 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.087750    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:36.238812 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.238777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:36.719218 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.719182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:36.721910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.721881    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5eaddce2-e9fb-468e-916e-895583a9f2ac-node-exporter-tls\") pod \"node-exporter-zrvn5\" (UID: \"5eaddce2-e9fb-468e-916e-895583a9f2ac\") " pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:36.893242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:36.893206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zrvn5"
Jul 22 21:10:37.133803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:37.133773    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j7wnh"
Jul 22 21:10:37.253321 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:10:37.253289    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eaddce2_e9fb_468e_916e_895583a9f2ac.slice/crio-c2160f302b3cbad7c7eebd7c53da340eba1b2997bef35c394eaf911c4a6b99ea WatchSource:0}: Error finding container c2160f302b3cbad7c7eebd7c53da340eba1b2997bef35c394eaf911c4a6b99ea: Status 404 returned error can't find the container with id c2160f302b3cbad7c7eebd7c53da340eba1b2997bef35c394eaf911c4a6b99ea
Jul 22 21:10:37.562615 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:37.562578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:37.663383 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:37.663298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:38.185885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.184286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvn5" event={"ID":"5eaddce2-e9fb-468e-916e-895583a9f2ac","Type":"ContainerStarted","Data":"c2160f302b3cbad7c7eebd7c53da340eba1b2997bef35c394eaf911c4a6b99ea"}
Jul 22 21:10:38.188062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.188033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-b7smb" event={"ID":"e85294ab-9314-41b2-9f2a-de23aabf60f8","Type":"ContainerStarted","Data":"b46c54b5332e8f7ecbbac49189bd2a0c4725e1e166866680e7c5ac95604bfa65"}
Jul 22 21:10:38.188578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.188554    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:38.201162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.201097    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-b7smb"
Jul 22 21:10:38.206667 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.205988    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-b7smb" podStartSLOduration=1.878353181 podStartE2EDuration="20.205970139s" totalImagesPullingTime="18.327616958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:38.204831878 +0000 UTC m=+299.542446756" watchObservedRunningTime="2026-07-22 21:10:38.205970139 +0000 UTC m=+299.543585020"
Jul 22 21:10:38.252561 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.252473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:38.995382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:38.995351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:39.064685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.064659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:10:39.066751 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.066727    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:10:39.073916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.073896    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 21:10:39.094328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.094302    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:39.193235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.193052    2569 generic.go:356] "Generic (PLEG): container finished" podID="5eaddce2-e9fb-468e-916e-895583a9f2ac" containerID="2539ee199eed0076444fbaffe2853391972f3a3a66a92b2c2850fe1dfcf3d39d" exitCode=0
Jul 22 21:10:39.193235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.193167    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvn5" event={"ID":"5eaddce2-e9fb-468e-916e-895583a9f2ac","Type":"ContainerDied","Data":"2539ee199eed0076444fbaffe2853391972f3a3a66a92b2c2850fe1dfcf3d39d"}
Jul 22 21:10:39.986084 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:39.822966    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:40.151284 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.151250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:40.200809 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.200768    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvn5" event={"ID":"5eaddce2-e9fb-468e-916e-895583a9f2ac","Type":"ContainerStarted","Data":"27a0bf7f625647a2024b972950b36b5ca3a102dfa701601e3bacb77e22c2bea2"}
Jul 22 21:10:40.201274 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.200873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zrvn5" event={"ID":"5eaddce2-e9fb-468e-916e-895583a9f2ac","Type":"ContainerStarted","Data":"88ad1e36e3dfdde7eb4ebac4372b51bcdd8fe3892782cf0a6a7216526d43264d"}
Jul 22 21:10:40.228602 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.228571    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:40.228741 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.228557    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zrvn5" podStartSLOduration=3.824778514 podStartE2EDuration="5.228539575s" totalImagesPullingTime="1.304664383s" totalInitContainerRuntime="99.096678ms" isStatefulPod=true podCreationTimestamp="2026-07-22 21:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:40.226565313 +0000 UTC m=+301.564180191" watchObservedRunningTime="2026-07-22 21:10:40.228539575 +0000 UTC m=+301.566154458"
Jul 22 21:10:40.565225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.565186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:40.661517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.661476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:40.957884 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:40.957805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:41.058620 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:41.058590    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:41.099742 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:41.099716    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5744b9cc-s6n48"
Jul 22 21:10:41.254877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:41.254841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:41.402389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:41.402355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:41.506725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:41.506642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:44.929932 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:44.929893    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:45.029983 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:45.029945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:45.145353 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:45.145325    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:10:45.523394 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:45.523348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:45.577603 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:45.577566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:46.734962 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:46.734927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:47.773395 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:47.773355    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" podUID="8b2494bf-f07c-486b-849f-dfb598b9e339" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:10:48.176045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:48.175950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:52.112299 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:52.112264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:52.172695 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:52.172670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:55.270118 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:55.270082    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:55.371581 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:55.371554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:55.574343 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:55.574266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:55.675571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:55.675544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:55.754797 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:55.754768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:56.430934 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:56.430902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:56.484486 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:56.484455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:10:57.772684 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:10:57.772636    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" podUID="8b2494bf-f07c-486b-849f-dfb598b9e339" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:11:07.772908 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:07.772860    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" podUID="8b2494bf-f07c-486b-849f-dfb598b9e339" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 22 21:11:07.773346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:07.772942    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws"
Jul 22 21:11:07.773467 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:07.773433    2569 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c4a8fb7fbbc75625b60f8f529f275056bc612064f637a2fdb602c0a151881c4f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 22 21:11:07.773510 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:07.773497    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" podUID="8b2494bf-f07c-486b-849f-dfb598b9e339" containerName="service-proxy" containerID="cri-o://c4a8fb7fbbc75625b60f8f529f275056bc612064f637a2fdb602c0a151881c4f" gracePeriod=30
Jul 22 21:11:08.292812 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:08.292778    2569 generic.go:356] "Generic (PLEG): container finished" podID="8b2494bf-f07c-486b-849f-dfb598b9e339" containerID="c4a8fb7fbbc75625b60f8f529f275056bc612064f637a2fdb602c0a151881c4f" exitCode=2
Jul 22 21:11:08.292956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:08.292862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerDied","Data":"c4a8fb7fbbc75625b60f8f529f275056bc612064f637a2fdb602c0a151881c4f"}
Jul 22 21:11:08.292956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:08.292904    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846495fcdc-xk7ws" event={"ID":"8b2494bf-f07c-486b-849f-dfb598b9e339","Type":"ContainerStarted","Data":"0a6e54d53ae2d0d3db405214cde0a9953f05b5df67d59eeadaae7711470b7df8"}
Jul 22 21:11:26.713357 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:26.713310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:26.768633 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:26.768602    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:39.211036 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:39.210959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:39.274215 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:39.274185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:51.116898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:51.116853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:51.291997 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:51.291960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:52.947744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:52.947706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:11:52.950349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:52.950316    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a76272e-c625-4fe9-9a9c-bd16bf90c930-metrics-certs\") pod \"network-metrics-daemon-z7shg\" (UID: \"7a76272e-c625-4fe9-9a9c-bd16bf90c930\") " pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:11:53.248961 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:53.248935    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8629h\""
Jul 22 21:11:53.256995 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:53.256976    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7shg"
Jul 22 21:11:53.377651 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:53.377624    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7shg"]
Jul 22 21:11:53.380565 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:11:53.380541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a76272e_c625_4fe9_9a9c_bd16bf90c930.slice/crio-71ecec3cc0fde24c4510b9bb108bfe5116d4f4e4778c96d0d9b872a7d2b6d028 WatchSource:0}: Error finding container 71ecec3cc0fde24c4510b9bb108bfe5116d4f4e4778c96d0d9b872a7d2b6d028: Status 404 returned error can't find the container with id 71ecec3cc0fde24c4510b9bb108bfe5116d4f4e4778c96d0d9b872a7d2b6d028
Jul 22 21:11:53.382912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:53.382893    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:11:53.436572 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:53.436545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7shg" event={"ID":"7a76272e-c625-4fe9-9a9c-bd16bf90c930","Type":"ContainerStarted","Data":"71ecec3cc0fde24c4510b9bb108bfe5116d4f4e4778c96d0d9b872a7d2b6d028"}
Jul 22 21:11:54.441322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:54.441291    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7shg" event={"ID":"7a76272e-c625-4fe9-9a9c-bd16bf90c930","Type":"ContainerStarted","Data":"0f9379edb25c4724f1f94fbe213d78155133195f7eaa35fb4f7c6a57d13a808a"}
Jul 22 21:11:54.441650 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:54.441343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7shg" event={"ID":"7a76272e-c625-4fe9-9a9c-bd16bf90c930","Type":"ContainerStarted","Data":"5cac3ecfe679d50e08ba0c01347a3a517b97ff685de73f99cb5e19d1725a622a"}
Jul 22 21:11:54.459346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:54.459304    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z7shg" podStartSLOduration=374.618316931 podStartE2EDuration="6m15.45929004s" totalImagesPullingTime="840.973109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:11:54.458237834 +0000 UTC m=+375.795852788" watchObservedRunningTime="2026-07-22 21:11:54.45929004 +0000 UTC m=+375.796904914"
Jul 22 21:11:54.549672 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:54.549642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:11:54.605669 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:11:54.605639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:00.760927 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:00.760890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:00.861229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:00.861194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:01.290754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:01.290722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:01.391704 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:01.391673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:02.994576 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:02.994532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:03.048562 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:03.048530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:11.443707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:11.443669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:11.544903 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:11.544863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:11.895606 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:11.895573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:11.995486 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:11.995458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:12.086180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:12.086151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:23.632090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:23.632052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:49.039439 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:49.039390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:49.139577 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:49.139528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:12:49.633921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:12:49.633891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:15.950223 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:15.950181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:17.310480 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:17.310419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:19.562273 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:19.562233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:19.662206 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:19.662176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:21.112255 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:21.112220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:21.228916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:21.228884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:21.439019 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:21.438945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:21.608704 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:21.608679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:22.574265 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.574231    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"]
Jul 22 21:13:22.576622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.576606    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.579088 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.579070    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 22 21:13:22.579243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.579100    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 22 21:13:22.579243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.579120    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fqwnq\""
Jul 22 21:13:22.588165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.588145    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"]
Jul 22 21:13:22.735866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.735834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.735968 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.735868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.735968 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.735892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7cx\" (UniqueName: \"kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.836705 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.836644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.836705 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.836687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.836818 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.836722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7cx\" (UniqueName: \"kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.837007 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.836988    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.837071 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.837054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.845016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.844994    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7cx\" (UniqueName: \"kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:22.885415 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:22.885396    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:23.008292 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:23.008256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"]
Jul 22 21:13:23.011104 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:13:23.011073    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c87c76_2569_4bcf_8a72_ea55a834ba56.slice/crio-f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a WatchSource:0}: Error finding container f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a: Status 404 returned error can't find the container with id f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a
Jul 22 21:13:23.298973 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:23.298944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:23.477905 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:23.477870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:23.739273 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:23.739239    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq" event={"ID":"88c87c76-2569-4bcf-8a72-ea55a834ba56","Type":"ContainerStarted","Data":"f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a"}
Jul 22 21:13:24.549142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:24.549084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:26.554018 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:26.553992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:26.613272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:26.613236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:29.764331 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:29.764289    2569 generic.go:356] "Generic (PLEG): container finished" podID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerID="ea469861d9a2645f671886770395eefe8a960183a457f142fb03a5a19346af50" exitCode=0
Jul 22 21:13:29.764734 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:29.764378    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq" event={"ID":"88c87c76-2569-4bcf-8a72-ea55a834ba56","Type":"ContainerDied","Data":"ea469861d9a2645f671886770395eefe8a960183a457f142fb03a5a19346af50"}
Jul 22 21:13:31.140931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:31.140894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:33.779700 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:33.779666    2569 generic.go:356] "Generic (PLEG): container finished" podID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerID="721250d910ea083d9e3d7d496e28c2b9b368b3fe9cfdd223b3d3e8d9d57004ad" exitCode=0
Jul 22 21:13:33.780083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:33.779730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq" event={"ID":"88c87c76-2569-4bcf-8a72-ea55a834ba56","Type":"ContainerDied","Data":"721250d910ea083d9e3d7d496e28c2b9b368b3fe9cfdd223b3d3e8d9d57004ad"}
Jul 22 21:13:40.809455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:40.809423    2569 generic.go:356] "Generic (PLEG): container finished" podID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerID="35c5018ab4c7d57d1a79e1a8a0d4a44d1573fb1112c6ee0ad7637eeff02bba3a" exitCode=0
Jul 22 21:13:40.809793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:40.809509    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq" event={"ID":"88c87c76-2569-4bcf-8a72-ea55a834ba56","Type":"ContainerDied","Data":"35c5018ab4c7d57d1a79e1a8a0d4a44d1573fb1112c6ee0ad7637eeff02bba3a"}
Jul 22 21:13:41.934862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.934837    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:41.980765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.980737    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf7cx\" (UniqueName: \"kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx\") pod \"88c87c76-2569-4bcf-8a72-ea55a834ba56\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") "
Jul 22 21:13:41.980921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.980778    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util\") pod \"88c87c76-2569-4bcf-8a72-ea55a834ba56\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") "
Jul 22 21:13:41.980921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.980823    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle\") pod \"88c87c76-2569-4bcf-8a72-ea55a834ba56\" (UID: \"88c87c76-2569-4bcf-8a72-ea55a834ba56\") "
Jul 22 21:13:41.981270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.981244    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle" (OuterVolumeSpecName: "bundle") pod "88c87c76-2569-4bcf-8a72-ea55a834ba56" (UID: "88c87c76-2569-4bcf-8a72-ea55a834ba56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:13:41.983435 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.983400    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx" (OuterVolumeSpecName: "kube-api-access-lf7cx") pod "88c87c76-2569-4bcf-8a72-ea55a834ba56" (UID: "88c87c76-2569-4bcf-8a72-ea55a834ba56"). InnerVolumeSpecName "kube-api-access-lf7cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:13:41.986062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:41.986033    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util" (OuterVolumeSpecName: "util") pod "88c87c76-2569-4bcf-8a72-ea55a834ba56" (UID: "88c87c76-2569-4bcf-8a72-ea55a834ba56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:13:42.081656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.081574    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf7cx\" (UniqueName: \"kubernetes.io/projected/88c87c76-2569-4bcf-8a72-ea55a834ba56-kube-api-access-lf7cx\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:13:42.081656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.081611    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-util\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:13:42.081656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.081621    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88c87c76-2569-4bcf-8a72-ea55a834ba56-bundle\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:13:42.817422 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.817401    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq"
Jul 22 21:13:42.817592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.817394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb52qq" event={"ID":"88c87c76-2569-4bcf-8a72-ea55a834ba56","Type":"ContainerDied","Data":"f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a"}
Jul 22 21:13:42.817592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:42.817512    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6d74b864f8496552035dfd454fd494e9a03a435a04792e74452992c4e9e309a"
Jul 22 21:13:43.420305 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:43.420275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:43.478097 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:43.478071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:43.620174 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:43.620119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:43.718815 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:43.718749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:49.428916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:49.428877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:49.529622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:49.529595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:51.185314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:51.185282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:55.446070 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:55.446032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:13:55.529196 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:13:55.529166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:05.042498 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:05.042468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:05.137480 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:05.137449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:05.697086 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:05.697052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:05.936554 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:05.936517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.037139 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.037102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.070586 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070555    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"]
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070768    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="pull"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070779    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="pull"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070787    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="extract"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070792    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="extract"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070803    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="util"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070809    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="util"
Jul 22 21:14:06.070877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.070848    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="88c87c76-2569-4bcf-8a72-ea55a834ba56" containerName="extract"
Jul 22 21:14:06.072765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.072751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.077920 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.077896    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 21:14:06.078076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.078054    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q65kp\""
Jul 22 21:14:06.079064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.078793    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 21:14:06.079064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.078806    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 21:14:06.079064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.078837    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 21:14:06.085757 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.085734    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"]
Jul 22 21:14:06.137177 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.137154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.137287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.137191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.137287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.137220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.137287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.137248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggz66\" (UniqueName: \"kubernetes.io/projected/31077411-67b0-4bcb-a206-dac4a35ba902-kube-api-access-ggz66\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.137413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.137300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238274    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238391 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238391 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238391 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggz66\" (UniqueName: \"kubernetes.io/projected/31077411-67b0-4bcb-a206-dac4a35ba902-kube-api-access-ggz66\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238545 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.238698 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.238679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.240772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.240752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31077411-67b0-4bcb-a206-dac4a35ba902-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.240857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.240835    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.240912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.240863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31077411-67b0-4bcb-a206-dac4a35ba902-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.248451 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.248431    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggz66\" (UniqueName: \"kubernetes.io/projected/31077411-67b0-4bcb-a206-dac4a35ba902-kube-api-access-ggz66\") pod \"opendatahub-operator-controller-manager-5b88fc4594-55m2h\" (UID: \"31077411-67b0-4bcb-a206-dac4a35ba902\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.257569 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.257542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.355658 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.355606    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.382502 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.382480    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:06.459771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.459729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.515798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.515775    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"]
Jul 22 21:14:06.518307 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:06.518282    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31077411_67b0_4bcb_a206_dac4a35ba902.slice/crio-3fc579719067d91e5f4da4b5c523d9699260004ed9270af56c19f3905959e861 WatchSource:0}: Error finding container 3fc579719067d91e5f4da4b5c523d9699260004ed9270af56c19f3905959e861: Status 404 returned error can't find the container with id 3fc579719067d91e5f4da4b5c523d9699260004ed9270af56c19f3905959e861
Jul 22 21:14:06.542506 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.542476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.635495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.635438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:06.893916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:06.893850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h" event={"ID":"31077411-67b0-4bcb-a206-dac4a35ba902","Type":"ContainerStarted","Data":"3fc579719067d91e5f4da4b5c523d9699260004ed9270af56c19f3905959e861"}
Jul 22 21:14:09.907527 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:09.907451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h" event={"ID":"31077411-67b0-4bcb-a206-dac4a35ba902","Type":"ContainerStarted","Data":"e4ccb1ba4905aec5aa189a3deb9fd661375e83cec2dece1874f78566b14ea468"}
Jul 22 21:14:10.912703 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:10.912671    2569 generic.go:356] "Generic (PLEG): container finished" podID="31077411-67b0-4bcb-a206-dac4a35ba902" containerID="e4ccb1ba4905aec5aa189a3deb9fd661375e83cec2dece1874f78566b14ea468" exitCode=0
Jul 22 21:14:10.913048 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:10.912730    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h" event={"ID":"31077411-67b0-4bcb-a206-dac4a35ba902","Type":"ContainerDied","Data":"e4ccb1ba4905aec5aa189a3deb9fd661375e83cec2dece1874f78566b14ea468"}
Jul 22 21:14:11.919213 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:11.919172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h" event={"ID":"31077411-67b0-4bcb-a206-dac4a35ba902","Type":"ContainerStarted","Data":"3cbfe7fe454f0bc0b39b3ef8eaf250fa05c0d65303b48bbcba1d1a68bb069e5c"}
Jul 22 21:14:11.919602 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:11.919330    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:11.942074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:11.942035    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h" podStartSLOduration=1.564567072 podStartE2EDuration="5.942020878s" totalImagesPullingTime="3.397337489s" totalInitContainerRuntime="980.116317ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:11.940420553 +0000 UTC m=+513.278035445" watchObservedRunningTime="2026-07-22 21:14:11.942020878 +0000 UTC m=+513.279635756"
Jul 22 21:14:18.195500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:18.195458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:18.302746 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:18.302712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:19.296051 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:19.296018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:19.740147 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:19.740093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:19.846857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:19.846818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:22.925024 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:22.924993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-55m2h"
Jul 22 21:14:25.239093 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.239059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:25.360975 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.360939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:25.891815 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.891777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:25.960868 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.960824    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"]
Jul 22 21:14:25.968856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.968836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:25.971699 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.971679    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 21:14:25.971782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.971677    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 21:14:25.971782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.971739    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sx866\""
Jul 22 21:14:25.972774 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.972759    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 21:14:25.972774 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.972769    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 21:14:25.979361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:25.979342    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"]
Jul 22 21:14:26.072348 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.072318    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s7dm\" (UniqueName: \"kubernetes.io/projected/595d0fae-89d4-475a-a136-f5af667d9aa3-kube-api-access-7s7dm\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.072514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.072385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595d0fae-89d4-475a-a136-f5af667d9aa3-tmp\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.072514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.072410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595d0fae-89d4-475a-a136-f5af667d9aa3-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.079625 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.079596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:26.102972 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.102934    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fd7gz"]
Jul 22 21:14:26.106235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.106217    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.111180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.111157    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qxkwp\""
Jul 22 21:14:26.111498 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.111474    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 21:14:26.118682 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.118657    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fd7gz"]
Jul 22 21:14:26.171841 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.171763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:26.172682 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.172664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78cfj\" (UniqueName: \"kubernetes.io/projected/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-kube-api-access-78cfj\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.172731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.172710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595d0fae-89d4-475a-a136-f5af667d9aa3-tmp\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.172770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.172754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595d0fae-89d4-475a-a136-f5af667d9aa3-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.172812 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.172796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.172856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.172817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s7dm\" (UniqueName: \"kubernetes.io/projected/595d0fae-89d4-475a-a136-f5af667d9aa3-kube-api-access-7s7dm\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.174984 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.174959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/595d0fae-89d4-475a-a136-f5af667d9aa3-tmp\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.175211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.175193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/595d0fae-89d4-475a-a136-f5af667d9aa3-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.180745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.180727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s7dm\" (UniqueName: \"kubernetes.io/projected/595d0fae-89d4-475a-a136-f5af667d9aa3-kube-api-access-7s7dm\") pod \"kube-auth-proxy-7f89f554cd-bl4zn\" (UID: \"595d0fae-89d4-475a-a136-f5af667d9aa3\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.271734 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.271701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:26.273793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.273754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78cfj\" (UniqueName: \"kubernetes.io/projected/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-kube-api-access-78cfj\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.273910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.273826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.273957 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:14:26.273911    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 21:14:26.273992 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:14:26.273966    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert podName:f475fbcc-8b3a-4394-9e7e-1faf9e6c3414 nodeName:}" failed. No retries permitted until 2026-07-22 21:14:26.773952535 +0000 UTC m=+528.111567390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert") pod "odh-model-controller-7998c67dc4-fd7gz" (UID: "f475fbcc-8b3a-4394-9e7e-1faf9e6c3414") : secret "odh-model-controller-webhook-cert" not found
Jul 22 21:14:26.278339 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.278324    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"
Jul 22 21:14:26.286280 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.286262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78cfj\" (UniqueName: \"kubernetes.io/projected/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-kube-api-access-78cfj\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.371678 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.371655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:26.412163 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.412094    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn"]
Jul 22 21:14:26.415035 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:26.415002    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595d0fae_89d4_475a_a136_f5af667d9aa3.slice/crio-b835e8d7a9f68ab5a6015f01457afdf8b07256dbcbfb2b2dd585afd207ece69b WatchSource:0}: Error finding container b835e8d7a9f68ab5a6015f01457afdf8b07256dbcbfb2b2dd585afd207ece69b: Status 404 returned error can't find the container with id b835e8d7a9f68ab5a6015f01457afdf8b07256dbcbfb2b2dd585afd207ece69b
Jul 22 21:14:26.741068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.741028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:26.778270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.778239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.780669 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.780644    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f475fbcc-8b3a-4394-9e7e-1faf9e6c3414-cert\") pod \"odh-model-controller-7998c67dc4-fd7gz\" (UID: \"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414\") " pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:26.971652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.971620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn" event={"ID":"595d0fae-89d4-475a-a136-f5af667d9aa3","Type":"ContainerStarted","Data":"b835e8d7a9f68ab5a6015f01457afdf8b07256dbcbfb2b2dd585afd207ece69b"}
Jul 22 21:14:26.996402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:26.996334    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wm56c"]
Jul 22 21:14:27.000960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.000941    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.004153 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.004114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 21:14:27.014397 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.014375    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wm56c"]
Jul 22 21:14:27.016193 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.016084    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:27.027400 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.027365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:27.081185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.081157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.081324 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.081205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvwj\" (UniqueName: \"kubernetes.io/projected/f14b3603-e793-4ce0-9cf7-11a64262d044-kube-api-access-gkvwj\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.150691 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.150647    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:27.155162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.155023    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fd7gz"]
Jul 22 21:14:27.156756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.156728    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:27.157407 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:27.157384    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf475fbcc_8b3a_4394_9e7e_1faf9e6c3414.slice/crio-7f11f6e9a6a6fd2b5445ba72cd992f5abbc64ed9260e78d778e0c94afd796380 WatchSource:0}: Error finding container 7f11f6e9a6a6fd2b5445ba72cd992f5abbc64ed9260e78d778e0c94afd796380: Status 404 returned error can't find the container with id 7f11f6e9a6a6fd2b5445ba72cd992f5abbc64ed9260e78d778e0c94afd796380
Jul 22 21:14:27.160405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.160386    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.162976 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.162941    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 21:14:27.163101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.162981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 21:14:27.163101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.162941    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 21:14:27.163101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.162986    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fxhcg\""
Jul 22 21:14:27.163312 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.163291    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 21:14:27.177581 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.177551    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:27.182246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.182223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.182334 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.182282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvwj\" (UniqueName: \"kubernetes.io/projected/f14b3603-e793-4ce0-9cf7-11a64262d044-kube-api-access-gkvwj\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.182628 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:14:27.182604    2569 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 22 21:14:27.182700 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:14:27.182689    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs podName:f14b3603-e793-4ce0-9cf7-11a64262d044 nodeName:}" failed. No retries permitted until 2026-07-22 21:14:27.682669718 +0000 UTC m=+529.020284577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs") pod "model-serving-api-54d89bd5fc-wm56c" (UID: "f14b3603-e793-4ce0-9cf7-11a64262d044") : secret "model-serving-api-tls" not found
Jul 22 21:14:27.196822 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.196777    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvwj\" (UniqueName: \"kubernetes.io/projected/f14b3603-e793-4ce0-9cf7-11a64262d044-kube-api-access-gkvwj\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.228429 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.228394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:27.283203 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283203 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmzk\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.283668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.283460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.384660 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.384564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.384847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.384721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.384847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.384751    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmzk\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.384847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.384816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.385089 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.385067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.385179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.385108    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.385244 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.385196    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.386171 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.386115    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.387692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.387651    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.388710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.387804    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.388710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.388288    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.388710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.388471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.400824 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.400801    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmzk\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.401325 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.401306    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token\") pod \"istiod-openshift-gateway-7574459656-pl7l4\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.456936 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.456895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:27.470713 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.470690    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:27.617660 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.617632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:27.620341 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:27.620297    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a19bfe4_3a3a_4dba_90f3_7d7268bf523f.slice/crio-b3d1cb863d2cad0897764aa8c6385b2394ac32dc548d4a2d99886e773ce2479f WatchSource:0}: Error finding container b3d1cb863d2cad0897764aa8c6385b2394ac32dc548d4a2d99886e773ce2479f: Status 404 returned error can't find the container with id b3d1cb863d2cad0897764aa8c6385b2394ac32dc548d4a2d99886e773ce2479f
Jul 22 21:14:27.689005 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.688972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.691695 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.691673    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f14b3603-e793-4ce0-9cf7-11a64262d044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wm56c\" (UID: \"f14b3603-e793-4ce0-9cf7-11a64262d044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.910613 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.910500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:27.979839 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.979781    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz" event={"ID":"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414","Type":"ContainerStarted","Data":"7f11f6e9a6a6fd2b5445ba72cd992f5abbc64ed9260e78d778e0c94afd796380"}
Jul 22 21:14:27.981581 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:27.981550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" event={"ID":"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f","Type":"ContainerStarted","Data":"b3d1cb863d2cad0897764aa8c6385b2394ac32dc548d4a2d99886e773ce2479f"}
Jul 22 21:14:28.084020 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:28.083749    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wm56c"]
Jul 22 21:14:28.089378 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:28.089346    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14b3603_e793_4ce0_9cf7_11a64262d044.slice/crio-af7102673634bbde8aac62a83db45262e728328440321f31a5aaca26c8d78736 WatchSource:0}: Error finding container af7102673634bbde8aac62a83db45262e728328440321f31a5aaca26c8d78736: Status 404 returned error can't find the container with id af7102673634bbde8aac62a83db45262e728328440321f31a5aaca26c8d78736
Jul 22 21:14:28.174755 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:28.174672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:28.987900 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:28.987858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c" event={"ID":"f14b3603-e793-4ce0-9cf7-11a64262d044","Type":"ContainerStarted","Data":"af7102673634bbde8aac62a83db45262e728328440321f31a5aaca26c8d78736"}
Jul 22 21:14:32.166344 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:32.166290    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:14:32.166620 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:32.166348    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:14:33.006964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.006858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz" event={"ID":"f475fbcc-8b3a-4394-9e7e-1faf9e6c3414","Type":"ContainerStarted","Data":"0303b038b8d1dc64a5685ab24c10dc42f4cd8da866b1674f2ccb748195d695e7"}
Jul 22 21:14:33.006964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.006967    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:33.008507 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.008479    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c" event={"ID":"f14b3603-e793-4ce0-9cf7-11a64262d044","Type":"ContainerStarted","Data":"6c93b2c3ac49283b6ba18c5bd822ef7b5908d2c43c3ad106870f7d91f188c178"}
Jul 22 21:14:33.008641 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.008572    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:33.010166 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.010115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" event={"ID":"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f","Type":"ContainerStarted","Data":"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"}
Jul 22 21:14:33.010326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.010303    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:33.011924 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.011898    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn" event={"ID":"595d0fae-89d4-475a-a136-f5af667d9aa3","Type":"ContainerStarted","Data":"a86f241cdba0b378d6cdc2fddfd153c00e391a242db6fd0874f4bd2896867326"}
Jul 22 21:14:33.012009 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.011957    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pl7l4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:14:33.012009 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.011995    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:14:33.024415 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.024370    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz" podStartSLOduration=2.025191486 podStartE2EDuration="7.024354695s" totalImagesPullingTime="4.999163209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:33.023121534 +0000 UTC m=+534.360736424" watchObservedRunningTime="2026-07-22 21:14:33.024354695 +0000 UTC m=+534.361969572"
Jul 22 21:14:33.040045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.040008    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c" podStartSLOduration=2.967514828 podStartE2EDuration="7.039994517s" totalImagesPullingTime="4.072479689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:33.038678557 +0000 UTC m=+534.376293434" watchObservedRunningTime="2026-07-22 21:14:33.039994517 +0000 UTC m=+534.377609392"
Jul 22 21:14:33.057874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.057826    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" podStartSLOduration=1.5144313839999999 podStartE2EDuration="6.057813583s" totalImagesPullingTime="4.543382199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:33.056236184 +0000 UTC m=+534.393851061" watchObservedRunningTime="2026-07-22 21:14:33.057813583 +0000 UTC m=+534.395428456"
Jul 22 21:14:33.073585 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.073536    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-bl4zn" podStartSLOduration=2.390561106 podStartE2EDuration="8.073523434s" totalImagesPullingTime="5.682962328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:33.072053568 +0000 UTC m=+534.409668445" watchObservedRunningTime="2026-07-22 21:14:33.073523434 +0000 UTC m=+534.411138311"
Jul 22 21:14:33.266721 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.266633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:33.367617 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.367581    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:33.954731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:33.954693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:34.017652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.017624    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:34.101898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.101861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:34.229968 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.229878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:34.351178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.351141    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"]
Jul 22 21:14:34.354481 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.354460    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.366793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.366770    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"]
Jul 22 21:14:34.448970 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.448938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce60bb0-8b90-4da0-8c15-3e438d2fd574-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.448970 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.448970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.449184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.448997    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.449184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.449044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xhz\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-kube-api-access-q9xhz\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.449184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.449113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.449184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.449150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.449184 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.449169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550525 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550525 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce60bb0-8b90-4da0-8c15-3e438d2fd574-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.550758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.550667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xhz\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-kube-api-access-q9xhz\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.551273 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.551250    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.553027 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.552998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce60bb0-8b90-4da0-8c15-3e438d2fd574-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.553239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.553220    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.553459 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.553445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.553527 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.553482    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.558001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.557981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.558222 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.558206    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xhz\" (UniqueName: \"kubernetes.io/projected/dce60bb0-8b90-4da0-8c15-3e438d2fd574-kube-api-access-q9xhz\") pod \"istiod-openshift-gateway-94bb8fbfd-w77kh\" (UID: \"dce60bb0-8b90-4da0-8c15-3e438d2fd574\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.662864 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.662836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:34.794629 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.794602    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"]
Jul 22 21:14:34.797958 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:34.797934    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce60bb0_8b90_4da0_8c15_3e438d2fd574.slice/crio-2265f01d5395fe573b3b39d0899a15e9bbb445164a052bf46dc9bcc298ee343c WatchSource:0}: Error finding container 2265f01d5395fe573b3b39d0899a15e9bbb445164a052bf46dc9bcc298ee343c: Status 404 returned error can't find the container with id 2265f01d5395fe573b3b39d0899a15e9bbb445164a052bf46dc9bcc298ee343c
Jul 22 21:14:34.801803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.801743    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:14:34.801803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:34.801801    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:14:35.023181 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.023119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh" event={"ID":"dce60bb0-8b90-4da0-8c15-3e438d2fd574","Type":"ContainerStarted","Data":"9386f14d504c3dba80109d29cd7a6f59eb158c8083b186a2198566986cf50cdd"}
Jul 22 21:14:35.023373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.023197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh" event={"ID":"dce60bb0-8b90-4da0-8c15-3e438d2fd574","Type":"ContainerStarted","Data":"2265f01d5395fe573b3b39d0899a15e9bbb445164a052bf46dc9bcc298ee343c"}
Jul 22 21:14:35.023512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.023489    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:35.025173 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.025121    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-w77kh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:14:35.025292 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.025202    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh" podUID="dce60bb0-8b90-4da0-8c15-3e438d2fd574" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:14:35.044662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:35.044608    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh" podStartSLOduration=1.044588605 podStartE2EDuration="1.044588605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:35.041965992 +0000 UTC m=+536.379580870" watchObservedRunningTime="2026-07-22 21:14:35.044588605 +0000 UTC m=+536.382203483"
Jul 22 21:14:36.028374 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.028348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w77kh"
Jul 22 21:14:36.079551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.079507    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:36.079737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.079682    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerName="discovery" containerID="cri-o://90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9" gracePeriod=30
Jul 22 21:14:36.320912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.320888    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:36.467061 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467020    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467085    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467114    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467190    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmzk\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467235    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467424 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467262    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.467424 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467309    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap\") pod \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\" (UID: \"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f\") "
Jul 22 21:14:36.468052 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.467832    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:14:36.469649 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.469602    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:14:36.469809 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.469769    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:14:36.469885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.469871    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk" (OuterVolumeSpecName: "kube-api-access-vqmzk") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "kube-api-access-vqmzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:14:36.469939 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.469883    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:14:36.470001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.469985    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts" (OuterVolumeSpecName: "cacerts") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:14:36.470050 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.470013    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs" (OuterVolumeSpecName: "local-certs") pod "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" (UID: "4a19bfe4-3a3a-4dba-90f3-7d7268bf523f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567788    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-dns-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567815    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-kubeconfig\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567825    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqmzk\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-kube-api-access-vqmzk\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567835    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-cacerts\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567844    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-local-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567852    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-csr-ca-configmap\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:36.567861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:36.567859    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:14:37.032857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.032824    2569 generic.go:356] "Generic (PLEG): container finished" podID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerID="90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9" exitCode=0
Jul 22 21:14:37.033317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.032869    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"
Jul 22 21:14:37.033317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.032869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" event={"ID":"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f","Type":"ContainerDied","Data":"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"}
Jul 22 21:14:37.033317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.032934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4" event={"ID":"4a19bfe4-3a3a-4dba-90f3-7d7268bf523f","Type":"ContainerDied","Data":"b3d1cb863d2cad0897764aa8c6385b2394ac32dc548d4a2d99886e773ce2479f"}
Jul 22 21:14:37.033317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.032971    2569 scope.go:117] "RemoveContainer" containerID="90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"
Jul 22 21:14:37.041572 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.041555    2569 scope.go:117] "RemoveContainer" containerID="90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"
Jul 22 21:14:37.041809 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:14:37.041789    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9\": container with ID starting with 90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9 not found: ID does not exist" containerID="90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"
Jul 22 21:14:37.041876 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.041816    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9"} err="failed to get container status \"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9\": rpc error: code = NotFound desc = could not find container \"90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9\": container with ID starting with 90c34f9d1f917bd172b63fdac589c612d3131956638d035923c24322ed86eea9 not found: ID does not exist"
Jul 22 21:14:37.059406 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.059385    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:37.067758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.067739    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pl7l4"]
Jul 22 21:14:37.150274 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.150248    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" path="/var/lib/kubelet/pods/4a19bfe4-3a3a-4dba-90f3-7d7268bf523f/volumes"
Jul 22 21:14:37.172940 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.172907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:37.226905 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.226879    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"]
Jul 22 21:14:37.227178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.227165    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerName="discovery"
Jul 22 21:14:37.227230 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.227180    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerName="discovery"
Jul 22 21:14:37.227230 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.227222    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a19bfe4-3a3a-4dba-90f3-7d7268bf523f" containerName="discovery"
Jul 22 21:14:37.231307 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.231290    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.233940 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.233923    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 21:14:37.234186 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.234170    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w8gjt\""
Jul 22 21:14:37.241950 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.241926    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"]
Jul 22 21:14:37.259892 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.259216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:37.373408 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.373326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc53625-d872-472c-8630-73d114818d8a-cert\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.373408 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.373381    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf64r\" (UniqueName: \"kubernetes.io/projected/ffc53625-d872-472c-8630-73d114818d8a-kube-api-access-lf64r\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.474078 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.474051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc53625-d872-472c-8630-73d114818d8a-cert\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.474245 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.474088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf64r\" (UniqueName: \"kubernetes.io/projected/ffc53625-d872-472c-8630-73d114818d8a-kube-api-access-lf64r\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.476441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.476416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:37.476993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.476975    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc53625-d872-472c-8630-73d114818d8a-cert\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.485963 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.485940    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf64r\" (UniqueName: \"kubernetes.io/projected/ffc53625-d872-472c-8630-73d114818d8a-kube-api-access-lf64r\") pod \"kserve-controller-manager-d6f4b65b8-4pdhk\" (UID: \"ffc53625-d872-472c-8630-73d114818d8a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.542114 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.542088    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:37.565068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.565034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:37.668807 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.668729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:37.669794 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:37.669773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"]
Jul 22 21:14:37.671816 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:14:37.671789    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc53625_d872_472c_8630_73d114818d8a.slice/crio-8f85131cdeae0ac97796f5e6c1632e8a5d5b76af75b302fdfb837c666d938e1a WatchSource:0}: Error finding container 8f85131cdeae0ac97796f5e6c1632e8a5d5b76af75b302fdfb837c666d938e1a: Status 404 returned error can't find the container with id 8f85131cdeae0ac97796f5e6c1632e8a5d5b76af75b302fdfb837c666d938e1a
Jul 22 21:14:38.039030 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:38.038995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk" event={"ID":"ffc53625-d872-472c-8630-73d114818d8a","Type":"ContainerStarted","Data":"8f85131cdeae0ac97796f5e6c1632e8a5d5b76af75b302fdfb837c666d938e1a"}
Jul 22 21:14:41.052964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:41.052920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk" event={"ID":"ffc53625-d872-472c-8630-73d114818d8a","Type":"ContainerStarted","Data":"c841a5c71409f0cba956be65eb7f8a4bbc1b2168c0e3ef6346522adc512a894c"}
Jul 22 21:14:41.053354 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:41.053005    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:14:41.071246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:41.071174    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk" podStartSLOduration=1.466451392 podStartE2EDuration="4.071159617s" totalImagesPullingTime="2.604708225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:41.070272666 +0000 UTC m=+542.407887544" watchObservedRunningTime="2026-07-22 21:14:41.071159617 +0000 UTC m=+542.408774490"
Jul 22 21:14:42.148867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:42.148818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:42.248736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:42.248684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:14:44.019494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:44.019466    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fd7gz"
Jul 22 21:14:44.021367 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:44.021346    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wm56c"
Jul 22 21:14:49.007118 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:14:49.007066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:09.097028 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:09.096978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:09.198592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:09.198554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:12.062211 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:12.062183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4pdhk"
Jul 22 21:15:20.605914 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:20.605878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:22.450190 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:22.450158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:22.507170 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:22.507143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:26.751698 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:26.751657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:26.849927 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:26.849892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:26.921499 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:26.921465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:27.451413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.451374    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9lj9s"]
Jul 22 21:15:27.461589 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.461567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:27.464362 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.464333    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 21:15:27.464611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.464591    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xhrpl\""
Jul 22 21:15:27.464754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.464738    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 21:15:27.464870 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.464740    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9lj9s"]
Jul 22 21:15:27.533734 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.533707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dszvx\" (UniqueName: \"kubernetes.io/projected/a65fd718-0087-4668-9dca-b87565712c56-kube-api-access-dszvx\") pod \"kuadrant-operator-catalog-9lj9s\" (UID: \"a65fd718-0087-4668-9dca-b87565712c56\") " pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:27.634318 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.634285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dszvx\" (UniqueName: \"kubernetes.io/projected/a65fd718-0087-4668-9dca-b87565712c56-kube-api-access-dszvx\") pod \"kuadrant-operator-catalog-9lj9s\" (UID: \"a65fd718-0087-4668-9dca-b87565712c56\") " pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:27.647497 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.647470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dszvx\" (UniqueName: \"kubernetes.io/projected/a65fd718-0087-4668-9dca-b87565712c56-kube-api-access-dszvx\") pod \"kuadrant-operator-catalog-9lj9s\" (UID: \"a65fd718-0087-4668-9dca-b87565712c56\") " pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:27.771988 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.771962    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:27.897185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:27.897158    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9lj9s"]
Jul 22 21:15:27.899738 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:15:27.899712    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65fd718_0087_4668_9dca_b87565712c56.slice/crio-16b6a1eab29a069253d29a077c58dd6b9ea2bd2d406012444162295ad41ac473 WatchSource:0}: Error finding container 16b6a1eab29a069253d29a077c58dd6b9ea2bd2d406012444162295ad41ac473: Status 404 returned error can't find the container with id 16b6a1eab29a069253d29a077c58dd6b9ea2bd2d406012444162295ad41ac473
Jul 22 21:15:28.234756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:28.234726    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s" event={"ID":"a65fd718-0087-4668-9dca-b87565712c56","Type":"ContainerStarted","Data":"16b6a1eab29a069253d29a077c58dd6b9ea2bd2d406012444162295ad41ac473"}
Jul 22 21:15:30.244381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:30.244351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s" event={"ID":"a65fd718-0087-4668-9dca-b87565712c56","Type":"ContainerStarted","Data":"cc2bacdf8a7cad79e145b2739eb43c9bfb7b921844a85cc3fbd749946cea820a"}
Jul 22 21:15:30.261096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:30.261052    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s" podStartSLOduration=1.419534416 podStartE2EDuration="3.261037936s" totalImagesPullingTime="1.84150352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:15:30.259687197 +0000 UTC m=+591.597302073" watchObservedRunningTime="2026-07-22 21:15:30.261037936 +0000 UTC m=+591.598652813"
Jul 22 21:15:37.772679 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:37.772641    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:37.773153 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:37.772733    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:37.794272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:37.794250    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:38.293530 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:38.293502    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9lj9s"
Jul 22 21:15:39.091660 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:39.091628    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:15:39.092074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:39.092017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:15:43.668823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.668789    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"]
Jul 22 21:15:43.672324 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.672299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.675226 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.675207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-269gt\""
Jul 22 21:15:43.678104 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.678081    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"]
Jul 22 21:15:43.746046 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.746018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.746182 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.746061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.746182 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.746116    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brc2p\" (UniqueName: \"kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.847313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.847286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.847409 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.847334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brc2p\" (UniqueName: \"kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.847409 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.847361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.847648 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.847631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.847710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.847692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.856829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.856812    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brc2p\" (UniqueName: \"kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:43.981708 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:43.981692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:44.110543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:44.110520    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"]
Jul 22 21:15:44.113014 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:15:44.112991    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda6ceaf_d86d_4821_bc34_86c03cd51c55.slice/crio-7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb WatchSource:0}: Error finding container 7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb: Status 404 returned error can't find the container with id 7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb
Jul 22 21:15:44.295909 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:44.295854    2569 generic.go:356] "Generic (PLEG): container finished" podID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerID="1566aac249be04889a5063c7dd5cffa9b3d5b20baba8c8e74fc30d4b4a565e4c" exitCode=0
Jul 22 21:15:44.296002 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:44.295923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn" event={"ID":"bda6ceaf-d86d-4821-bc34-86c03cd51c55","Type":"ContainerDied","Data":"1566aac249be04889a5063c7dd5cffa9b3d5b20baba8c8e74fc30d4b4a565e4c"}
Jul 22 21:15:44.296002 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:44.295979    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn" event={"ID":"bda6ceaf-d86d-4821-bc34-86c03cd51c55","Type":"ContainerStarted","Data":"7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb"}
Jul 22 21:15:45.301315 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:45.301286    2569 generic.go:356] "Generic (PLEG): container finished" podID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerID="93dec423a547bf2fafa581c8631e24c957526e024c7edf2c4e518116f995ae83" exitCode=0
Jul 22 21:15:45.301626 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:45.301340    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn" event={"ID":"bda6ceaf-d86d-4821-bc34-86c03cd51c55","Type":"ContainerDied","Data":"93dec423a547bf2fafa581c8631e24c957526e024c7edf2c4e518116f995ae83"}
Jul 22 21:15:46.306719 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:46.306689    2569 generic.go:356] "Generic (PLEG): container finished" podID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerID="5d4a77069a754bb9779f7594b5919c84364724970033317db8cbf9114f5f8b66" exitCode=0
Jul 22 21:15:46.307086 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:46.306740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn" event={"ID":"bda6ceaf-d86d-4821-bc34-86c03cd51c55","Type":"ContainerDied","Data":"5d4a77069a754bb9779f7594b5919c84364724970033317db8cbf9114f5f8b66"}
Jul 22 21:15:47.437440 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.437415    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:47.570798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.570745    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brc2p\" (UniqueName: \"kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p\") pod \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") "
Jul 22 21:15:47.570907 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.570797    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle\") pod \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") "
Jul 22 21:15:47.570907 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.570825    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util\") pod \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\" (UID: \"bda6ceaf-d86d-4821-bc34-86c03cd51c55\") "
Jul 22 21:15:47.571405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.571377    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle" (OuterVolumeSpecName: "bundle") pod "bda6ceaf-d86d-4821-bc34-86c03cd51c55" (UID: "bda6ceaf-d86d-4821-bc34-86c03cd51c55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:15:47.572889 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.572868    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p" (OuterVolumeSpecName: "kube-api-access-brc2p") pod "bda6ceaf-d86d-4821-bc34-86c03cd51c55" (UID: "bda6ceaf-d86d-4821-bc34-86c03cd51c55"). InnerVolumeSpecName "kube-api-access-brc2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:15:47.578607 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.578581    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util" (OuterVolumeSpecName: "util") pod "bda6ceaf-d86d-4821-bc34-86c03cd51c55" (UID: "bda6ceaf-d86d-4821-bc34-86c03cd51c55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:15:47.671707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.671683    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brc2p\" (UniqueName: \"kubernetes.io/projected/bda6ceaf-d86d-4821-bc34-86c03cd51c55-kube-api-access-brc2p\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:15:47.671707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.671705    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-bundle\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:15:47.671813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.671715    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda6ceaf-d86d-4821-bc34-86c03cd51c55-util\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:15:47.768134 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:47.768102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:48.316317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:48.316282    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn"
Jul 22 21:15:48.316317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:48.316308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn" event={"ID":"bda6ceaf-d86d-4821-bc34-86c03cd51c55","Type":"ContainerDied","Data":"7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb"}
Jul 22 21:15:48.316496 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:48.316355    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a9542aa6b65cab93ad4486e54c32ce4575c50c276ed97d04a9745ae6a1806fb"
Jul 22 21:15:49.190254 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:49.190227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:55.692866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:55.692830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:56.288842 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:56.288806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:57.320003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:57.319974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:57.435373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:57.435346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:59.050229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.050192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:59.149511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.149484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:59.296293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.296270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:15:59.832471 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832390    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"]
Jul 22 21:15:59.832745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832728    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="extract"
Jul 22 21:15:59.832820 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832748    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="extract"
Jul 22 21:15:59.832820 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832765    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="pull"
Jul 22 21:15:59.832820 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832773    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="pull"
Jul 22 21:15:59.832820 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832801    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="util"
Jul 22 21:15:59.832820 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832812    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="util"
Jul 22 21:15:59.833040 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.832878    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda6ceaf-d86d-4821-bc34-86c03cd51c55" containerName="extract"
Jul 22 21:15:59.839110 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.839083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:15:59.842220 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.842194    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nzcwz\""
Jul 22 21:15:59.847169 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.847121    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"]
Jul 22 21:15:59.959737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:15:59.959707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lhg\" (UniqueName: \"kubernetes.io/projected/6c7f2362-8730-427e-893c-9b5b20247054-kube-api-access-t5lhg\") pod \"authorino-operator-75cc8d5cb7-2mxg6\" (UID: \"6c7f2362-8730-427e-893c-9b5b20247054\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:00.060887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.060859    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lhg\" (UniqueName: \"kubernetes.io/projected/6c7f2362-8730-427e-893c-9b5b20247054-kube-api-access-t5lhg\") pod \"authorino-operator-75cc8d5cb7-2mxg6\" (UID: \"6c7f2362-8730-427e-893c-9b5b20247054\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:00.072956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.072924    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lhg\" (UniqueName: \"kubernetes.io/projected/6c7f2362-8730-427e-893c-9b5b20247054-kube-api-access-t5lhg\") pod \"authorino-operator-75cc8d5cb7-2mxg6\" (UID: \"6c7f2362-8730-427e-893c-9b5b20247054\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:00.149673 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.149616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:00.275235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.275211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"]
Jul 22 21:16:00.277323 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:16:00.277297    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7f2362_8730_427e_893c_9b5b20247054.slice/crio-91d65b01567eafca7bbad222359456ed9dc8157fa67942515fb57ff1718bd07a WatchSource:0}: Error finding container 91d65b01567eafca7bbad222359456ed9dc8157fa67942515fb57ff1718bd07a: Status 404 returned error can't find the container with id 91d65b01567eafca7bbad222359456ed9dc8157fa67942515fb57ff1718bd07a
Jul 22 21:16:00.366978 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.366949    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6" event={"ID":"6c7f2362-8730-427e-893c-9b5b20247054","Type":"ContainerStarted","Data":"91d65b01567eafca7bbad222359456ed9dc8157fa67942515fb57ff1718bd07a"}
Jul 22 21:16:00.898288 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:00.898255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:03.309596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:03.309570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:03.383118 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:03.383093    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6" event={"ID":"6c7f2362-8730-427e-893c-9b5b20247054","Type":"ContainerStarted","Data":"9b574f96116109b1b21a8751b01355c43d8c513aa28b80695cc9c97eec776762"}
Jul 22 21:16:03.383249 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:03.383238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:03.423614 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:03.423571    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6" podStartSLOduration=1.956127517 podStartE2EDuration="4.423557415s" totalImagesPullingTime="2.467429898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:03.422252349 +0000 UTC m=+624.759867226" watchObservedRunningTime="2026-07-22 21:16:03.423557415 +0000 UTC m=+624.761172292"
Jul 22 21:16:03.946901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:03.946834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:05.062464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.062430    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"]
Jul 22 21:16:05.068471 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.068452    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:05.071441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.071421    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4sd5h\""
Jul 22 21:16:05.071540 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.071525    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 21:16:05.076847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.076818    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"]
Jul 22 21:16:05.200191 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.200164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8c2w\" (UniqueName: \"kubernetes.io/projected/d83ce69c-321b-4c83-9c3f-c87e626b4a5a-kube-api-access-j8c2w\") pod \"dns-operator-controller-manager-864dd78c4c-f6mbv\" (UID: \"d83ce69c-321b-4c83-9c3f-c87e626b4a5a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:05.301390 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.301364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8c2w\" (UniqueName: \"kubernetes.io/projected/d83ce69c-321b-4c83-9c3f-c87e626b4a5a-kube-api-access-j8c2w\") pod \"dns-operator-controller-manager-864dd78c4c-f6mbv\" (UID: \"d83ce69c-321b-4c83-9c3f-c87e626b4a5a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:05.309437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.309416    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8c2w\" (UniqueName: \"kubernetes.io/projected/d83ce69c-321b-4c83-9c3f-c87e626b4a5a-kube-api-access-j8c2w\") pod \"dns-operator-controller-manager-864dd78c4c-f6mbv\" (UID: \"d83ce69c-321b-4c83-9c3f-c87e626b4a5a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:05.379330 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.379286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:05.521855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.521821    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"]
Jul 22 21:16:05.525612 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:16:05.525584    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83ce69c_321b_4c83_9c3f_c87e626b4a5a.slice/crio-2878c8d4405ae5ce5530158d11c179ff0f9f1c98281518a3433e69a889e3d172 WatchSource:0}: Error finding container 2878c8d4405ae5ce5530158d11c179ff0f9f1c98281518a3433e69a889e3d172: Status 404 returned error can't find the container with id 2878c8d4405ae5ce5530158d11c179ff0f9f1c98281518a3433e69a889e3d172
Jul 22 21:16:05.708911 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:05.708853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:06.159812 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:06.159786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:06.397350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:06.397318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv" event={"ID":"d83ce69c-321b-4c83-9c3f-c87e626b4a5a","Type":"ContainerStarted","Data":"2878c8d4405ae5ce5530158d11c179ff0f9f1c98281518a3433e69a889e3d172"}
Jul 22 21:16:08.406715 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:08.406640    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv" event={"ID":"d83ce69c-321b-4c83-9c3f-c87e626b4a5a","Type":"ContainerStarted","Data":"c3643537069eac4b417c5600582a801ea810a0a5a2f7aa9994a74df6f8e261cc"}
Jul 22 21:16:08.407030 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:08.406734    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:08.427154 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:08.427078    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv" podStartSLOduration=0.954948882 podStartE2EDuration="3.427060596s" totalImagesPullingTime="2.472111714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:08.426989076 +0000 UTC m=+629.764603966" watchObservedRunningTime="2026-07-22 21:16:08.427060596 +0000 UTC m=+629.764675473"
Jul 22 21:16:09.230402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.230375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:09.820298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.820260    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"]
Jul 22 21:16:09.823466 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.823446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:09.826955 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.826939    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zhkzn\""
Jul 22 21:16:09.836687 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.836667    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"]
Jul 22 21:16:09.934307 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.934278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4tx\" (UniqueName: \"kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:09.934428 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:09.934315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.034867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.034839    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4tx\" (UniqueName: \"kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.034959 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.034881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.035282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.035266    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.046199 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.046178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4tx\" (UniqueName: \"kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.132835 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.132787    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:10.257496 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.257476    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"]
Jul 22 21:16:10.415559 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.415491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm" event={"ID":"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63","Type":"ContainerStarted","Data":"233ac490e9b5e2e6a7efa8bce78d2aa02bfe82503d8835669356a25bdfcb39e5"}
Jul 22 21:16:10.914697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:10.914670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:11.014838 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:11.014794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:11.298884 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:11.298851    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:11.498779 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:11.498742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:14.389597 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:14.389569    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2mxg6"
Jul 22 21:16:14.706514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:14.706438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:14.804057 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:14.804028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:17.448113 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:17.448066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm" event={"ID":"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63","Type":"ContainerStarted","Data":"164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1"}
Jul 22 21:16:17.448490 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:17.448160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:17.467949 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:17.467901    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm" podStartSLOduration=2.006787578 podStartE2EDuration="8.467889651s" totalImagesPullingTime="6.461102073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:17.465812498 +0000 UTC m=+638.803427386" watchObservedRunningTime="2026-07-22 21:16:17.467889651 +0000 UTC m=+638.805504527"
Jul 22 21:16:18.107908 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:18.107835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:18.208061 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:18.208034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:19.233205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:19.233157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:19.413262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:19.413238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f6mbv"
Jul 22 21:16:19.934512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:19.934460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:22.038793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:22.038764    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:22.139422 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:22.139397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:28.454041 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:28.454015    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.091603 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.091572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:30.188989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.188956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:30.212550 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.212523    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"]
Jul 22 21:16:30.212744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.212721    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" containerName="manager" containerID="cri-o://164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1" gracePeriod=2
Jul 22 21:16:30.223145 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.223103    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"]
Jul 22 21:16:30.232188 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.232160    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\": pods \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.234860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.234834    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:30.235279 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.235262    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" containerName="manager"
Jul 22 21:16:30.235279 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.235279    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" containerName="manager"
Jul 22 21:16:30.235434 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.235349    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" containerName="manager"
Jul 22 21:16:30.238392 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.238375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.240604 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.240578    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" is forbidden: User \"system:node:ip-10-0-142-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-246.ec2.internal' and this object" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.254859 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.254838    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:30.381665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.381627    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx62b\" (UniqueName: \"kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.381794 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.381767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.442640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.442608    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.444872 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.444848    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" is forbidden: User \"system:node:ip-10-0-142-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-246.ec2.internal' and this object" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.483242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.483219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx62b\" (UniqueName: \"kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.483330 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.483266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.483543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.483528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.493560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.493536    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx62b\" (UniqueName: \"kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gzv9n\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.501272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.501251    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" containerID="164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1" exitCode=0
Jul 22 21:16:30.501361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.501319    2569 scope.go:117] "RemoveContainer" containerID="164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1"
Jul 22 21:16:30.501361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.501295    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.503964 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.503938    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" is forbidden: User \"system:node:ip-10-0-142-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-246.ec2.internal' and this object" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.508971 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.508956    2569 scope.go:117] "RemoveContainer" containerID="164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1"
Jul 22 21:16:30.509234 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.509218    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1\": container with ID starting with 164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1 not found: ID does not exist" containerID="164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1"
Jul 22 21:16:30.509293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.509243    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1"} err="failed to get container status \"164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1\": rpc error: code = NotFound desc = could not find container \"164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1\": container with ID starting with 164c62569575afc43a47ad5d58a0577510fb9333ea1d76e7cb9b60280b6efcd1 not found: ID does not exist"
Jul 22 21:16:30.584214 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.584193    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh4tx\" (UniqueName: \"kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx\") pod \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") "
Jul 22 21:16:30.584293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.584227    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume\") pod \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\" (UID: \"a5e67ebe-dba7-4c3a-9240-c9322a0e2f63\") "
Jul 22 21:16:30.584699 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.584682    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" (UID: "a5e67ebe-dba7-4c3a-9240-c9322a0e2f63"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:16:30.585990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.585961    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx" (OuterVolumeSpecName: "kube-api-access-fh4tx") pod "a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" (UID: "a5e67ebe-dba7-4c3a-9240-c9322a0e2f63"). InnerVolumeSpecName "kube-api-access-fh4tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:16:30.599251 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.599233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:30.685713 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.685681    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh4tx\" (UniqueName: \"kubernetes.io/projected/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-kube-api-access-fh4tx\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:16:30.685713 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.685715    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63-extensions-socket-volume\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:16:30.701582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.701548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:30.738417 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.738391    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:30.741612 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:16:30.741580    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4b4ece_18f7_451b_ba1e_b29ba72b4f50.slice/crio-7e65a044e1050c583508d64a6088bb5dc5af6e32bc0bba72091a4dadb4e3bbc9 WatchSource:0}: Error finding container 7e65a044e1050c583508d64a6088bb5dc5af6e32bc0bba72091a4dadb4e3bbc9: Status 404 returned error can't find the container with id 7e65a044e1050c583508d64a6088bb5dc5af6e32bc0bba72091a4dadb4e3bbc9
Jul 22 21:16:30.811350 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:30.811324    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nj6hm\" is forbidden: User \"system:node:ip-10-0-142-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-246.ec2.internal' and this object" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nj6hm"
Jul 22 21:16:30.816578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:30.816556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:31.149983 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:31.149953    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e67ebe-dba7-4c3a-9240-c9322a0e2f63" path="/var/lib/kubelet/pods/a5e67ebe-dba7-4c3a-9240-c9322a0e2f63/volumes"
Jul 22 21:16:31.507033 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:31.506998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" event={"ID":"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50","Type":"ContainerStarted","Data":"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"}
Jul 22 21:16:31.507228 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:31.507061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" event={"ID":"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50","Type":"ContainerStarted","Data":"7e65a044e1050c583508d64a6088bb5dc5af6e32bc0bba72091a4dadb4e3bbc9"}
Jul 22 21:16:31.507228 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:31.507090    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:31.529499 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:31.529459    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" podStartSLOduration=1.529445592 podStartE2EDuration="1.529445592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:16:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:31.527390818 +0000 UTC m=+652.865005694" watchObservedRunningTime="2026-07-22 21:16:31.529445592 +0000 UTC m=+652.867060469"
Jul 22 21:16:34.113026 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:34.112991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:34.255610 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:34.255580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:36.480854 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:36.480822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:36.534182 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:36.534114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:41.896881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:41.896844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:41.997002 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:41.996958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:16:42.514346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:42.514315    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:46.133501 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.133468    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:46.133897 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.133636    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" podUID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" containerName="manager" containerID="cri-o://6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e" gracePeriod=10
Jul 22 21:16:46.396798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.396749    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:46.411690 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.411668    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:16:46.411995 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.411983    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" containerName="manager"
Jul 22 21:16:46.412042 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.411996    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" containerName="manager"
Jul 22 21:16:46.412076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.412054    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" containerName="manager"
Jul 22 21:16:46.429062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.429041    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:16:46.429170 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.429138    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.500247 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.500226    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume\") pod \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") "
Jul 22 21:16:46.500339 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.500313    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx62b\" (UniqueName: \"kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b\") pod \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\" (UID: \"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50\") "
Jul 22 21:16:46.500399 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.500376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.500455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.500398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9rxc\" (UniqueName: \"kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.500552 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.500530    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" (UID: "fa4b4ece-18f7-451b-ba1e-b29ba72b4f50"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:16:46.502390 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.502361    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b" (OuterVolumeSpecName: "kube-api-access-mx62b") pod "fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" (UID: "fa4b4ece-18f7-451b-ba1e-b29ba72b4f50"). InnerVolumeSpecName "kube-api-access-mx62b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:16:46.572418 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.572392    2569 generic.go:356] "Generic (PLEG): container finished" podID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" containerID="6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e" exitCode=0
Jul 22 21:16:46.572524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.572443    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"
Jul 22 21:16:46.572524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.572442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" event={"ID":"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50","Type":"ContainerDied","Data":"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"}
Jul 22 21:16:46.572594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.572562    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n" event={"ID":"fa4b4ece-18f7-451b-ba1e-b29ba72b4f50","Type":"ContainerDied","Data":"7e65a044e1050c583508d64a6088bb5dc5af6e32bc0bba72091a4dadb4e3bbc9"}
Jul 22 21:16:46.572594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.572590    2569 scope.go:117] "RemoveContainer" containerID="6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"
Jul 22 21:16:46.581215 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.581194    2569 scope.go:117] "RemoveContainer" containerID="6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"
Jul 22 21:16:46.581446 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:16:46.581428    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e\": container with ID starting with 6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e not found: ID does not exist" containerID="6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"
Jul 22 21:16:46.581502 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.581454    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e"} err="failed to get container status \"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e\": rpc error: code = NotFound desc = could not find container \"6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e\": container with ID starting with 6b319a76fb8ed9274a72796cfcfadbd33309d02b37ae21a39e1f07808b0a811e not found: ID does not exist"
Jul 22 21:16:46.599272 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.599250    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:46.600960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.600942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rxc\" (UniqueName: \"kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.601044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.601027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.601081 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.601073    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx62b\" (UniqueName: \"kubernetes.io/projected/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-kube-api-access-mx62b\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:16:46.601145 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.601087    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50-extensions-socket-volume\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:16:46.601381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.601361    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.609902 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.609883    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gzv9n"]
Jul 22 21:16:46.631988 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.631971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9rxc\" (UniqueName: \"kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc\") pod \"kuadrant-operator-controller-manager-86878c769f-zb5gn\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.738794 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.738773    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:46.892192 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:46.892164    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:16:46.895179 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:16:46.895152    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2819a8c1_b58f_464a_be89_9a98ffb9d20f.slice/crio-6e0d1a6c9026e2bab1a079c88514d84d19a22542ba577a6576f545995229833c WatchSource:0}: Error finding container 6e0d1a6c9026e2bab1a079c88514d84d19a22542ba577a6576f545995229833c: Status 404 returned error can't find the container with id 6e0d1a6c9026e2bab1a079c88514d84d19a22542ba577a6576f545995229833c
Jul 22 21:16:47.150525 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:47.150485    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4b4ece-18f7-451b-ba1e-b29ba72b4f50" path="/var/lib/kubelet/pods/fa4b4ece-18f7-451b-ba1e-b29ba72b4f50/volumes"
Jul 22 21:16:47.578944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:47.578910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" event={"ID":"2819a8c1-b58f-464a-be89-9a98ffb9d20f","Type":"ContainerStarted","Data":"ac6a3249396dfcbc3cd8a4de16bb2d878fef463e210b48eeab6a05ea4fb4fe80"}
Jul 22 21:16:47.579122 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:47.578962    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" event={"ID":"2819a8c1-b58f-464a-be89-9a98ffb9d20f","Type":"ContainerStarted","Data":"6e0d1a6c9026e2bab1a079c88514d84d19a22542ba577a6576f545995229833c"}
Jul 22 21:16:47.579122 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:47.579055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:16:47.607887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:47.607842    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" podStartSLOduration=1.607828371 podStartE2EDuration="1.607828371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:47.606865115 +0000 UTC m=+668.944479995" watchObservedRunningTime="2026-07-22 21:16:47.607828371 +0000 UTC m=+668.945443248"
Jul 22 21:16:58.585269 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:16:58.585243    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:17:02.453089 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:02.453051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:02.607741 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:02.607702    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:10.840351 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:10.840311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:10.891336 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:10.891310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:14.844847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:14.844814    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:14.945305 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:14.945257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:15.012901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.012860    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:15.697232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.697201    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:15.700426 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.700404    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:15.703236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.703213    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n7qhp\""
Jul 22 21:17:15.709173 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.709152    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:15.790646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.790603    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:15.807468 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.807439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9vrh\" (UniqueName: \"kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh\") pod \"authorino-58cd955675-gbrrs\" (UID: \"11f3c998-2be3-49bc-9625-2aa05a454182\") " pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:15.856282 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.856246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:15.907967 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.907935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vrh\" (UniqueName: \"kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh\") pod \"authorino-58cd955675-gbrrs\" (UID: \"11f3c998-2be3-49bc-9625-2aa05a454182\") " pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:15.915996 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:15.915953    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vrh\" (UniqueName: \"kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh\") pod \"authorino-58cd955675-gbrrs\" (UID: \"11f3c998-2be3-49bc-9625-2aa05a454182\") " pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:16.010725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:16.010704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:16.149159 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:16.148945    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:16.154869 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:17:16.154814    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f3c998_2be3_49bc_9625_2aa05a454182.slice/crio-2c368d7b7c5d897e10ac20f5d529d9e1dc613c5bbfd7c0a67d87d90e0571b6cb WatchSource:0}: Error finding container 2c368d7b7c5d897e10ac20f5d529d9e1dc613c5bbfd7c0a67d87d90e0571b6cb: Status 404 returned error can't find the container with id 2c368d7b7c5d897e10ac20f5d529d9e1dc613c5bbfd7c0a67d87d90e0571b6cb
Jul 22 21:17:16.156114 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:16.156094    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:17:16.702836 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:16.702801    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbrrs" event={"ID":"11f3c998-2be3-49bc-9625-2aa05a454182","Type":"ContainerStarted","Data":"2c368d7b7c5d897e10ac20f5d529d9e1dc613c5bbfd7c0a67d87d90e0571b6cb"}
Jul 22 21:17:19.719061 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:19.718980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbrrs" event={"ID":"11f3c998-2be3-49bc-9625-2aa05a454182","Type":"ContainerStarted","Data":"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"}
Jul 22 21:17:19.734197 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:19.734153    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gbrrs" podStartSLOduration=1.524814069 podStartE2EDuration="4.734120749s" totalImagesPullingTime="3.20930668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:19.732684904 +0000 UTC m=+701.070299786" watchObservedRunningTime="2026-07-22 21:17:19.734120749 +0000 UTC m=+701.071735626"
Jul 22 21:17:21.375888 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:21.375856    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:21.727676 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:21.727582    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gbrrs" podUID="11f3c998-2be3-49bc-9625-2aa05a454182" containerName="authorino" containerID="cri-o://818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176" gracePeriod=30
Jul 22 21:17:21.983339 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:21.983315    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:22.059829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.059797    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9vrh\" (UniqueName: \"kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh\") pod \"11f3c998-2be3-49bc-9625-2aa05a454182\" (UID: \"11f3c998-2be3-49bc-9625-2aa05a454182\") "
Jul 22 21:17:22.062081 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.062047    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh" (OuterVolumeSpecName: "kube-api-access-l9vrh") pod "11f3c998-2be3-49bc-9625-2aa05a454182" (UID: "11f3c998-2be3-49bc-9625-2aa05a454182"). InnerVolumeSpecName "kube-api-access-l9vrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:17:22.160473 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.160439    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9vrh\" (UniqueName: \"kubernetes.io/projected/11f3c998-2be3-49bc-9625-2aa05a454182-kube-api-access-l9vrh\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:17:22.732804 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.732768    2569 generic.go:356] "Generic (PLEG): container finished" podID="11f3c998-2be3-49bc-9625-2aa05a454182" containerID="818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176" exitCode=0
Jul 22 21:17:22.733209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.732809    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gbrrs"
Jul 22 21:17:22.733209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.732860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbrrs" event={"ID":"11f3c998-2be3-49bc-9625-2aa05a454182","Type":"ContainerDied","Data":"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"}
Jul 22 21:17:22.733209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.732902    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gbrrs" event={"ID":"11f3c998-2be3-49bc-9625-2aa05a454182","Type":"ContainerDied","Data":"2c368d7b7c5d897e10ac20f5d529d9e1dc613c5bbfd7c0a67d87d90e0571b6cb"}
Jul 22 21:17:22.733209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.732919    2569 scope.go:117] "RemoveContainer" containerID="818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"
Jul 22 21:17:22.741455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.741434    2569 scope.go:117] "RemoveContainer" containerID="818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"
Jul 22 21:17:22.741698 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:17:22.741681    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176\": container with ID starting with 818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176 not found: ID does not exist" containerID="818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"
Jul 22 21:17:22.741736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.741705    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176"} err="failed to get container status \"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176\": rpc error: code = NotFound desc = could not find container \"818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176\": container with ID starting with 818c01de662a39cb5e6cea0e626de616c1b350c988d352d90081e2791d278176 not found: ID does not exist"
Jul 22 21:17:22.753176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.753155    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:22.757004 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:22.756980    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gbrrs"]
Jul 22 21:17:23.150814 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:23.150735    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f3c998-2be3-49bc-9625-2aa05a454182" path="/var/lib/kubelet/pods/11f3c998-2be3-49bc-9625-2aa05a454182/volumes"
Jul 22 21:17:27.061729 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:27.061663    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:27.163707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:27.163677    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:35.707754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:35.707578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:35.796154 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:35.796089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:36.373432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:36.373398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:49.047120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.047082    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:49.241765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.241727    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptkv4"]
Jul 22 21:17:49.242045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.242032    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f3c998-2be3-49bc-9625-2aa05a454182" containerName="authorino"
Jul 22 21:17:49.242094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.242046    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f3c998-2be3-49bc-9625-2aa05a454182" containerName="authorino"
Jul 22 21:17:49.242160 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.242109    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f3c998-2be3-49bc-9625-2aa05a454182" containerName="authorino"
Jul 22 21:17:49.247452 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.247431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.250520 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.250497    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n7qhp\""
Jul 22 21:17:49.253363 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.253331    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptkv4"]
Jul 22 21:17:49.388340 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.388235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkrs2\" (UniqueName: \"kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2\") pod \"authorino-5d4b67c446-ptkv4\" (UID: \"54a7a6c1-0891-480e-888b-54bced69a7f3\") " pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.450281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.450240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:49.462566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.462530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptkv4"]
Jul 22 21:17:49.462791 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:17:49.462770    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wkrs2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-ptkv4" podUID="54a7a6c1-0891-480e-888b-54bced69a7f3"
Jul 22 21:17:49.489020 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.488985    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkrs2\" (UniqueName: \"kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2\") pod \"authorino-5d4b67c446-ptkv4\" (UID: \"54a7a6c1-0891-480e-888b-54bced69a7f3\") " pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.489602 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.489577    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:49.492030 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.492011    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:49.500094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.500071    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:49.502467 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.502444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkrs2\" (UniqueName: \"kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2\") pod \"authorino-5d4b67c446-ptkv4\" (UID: \"54a7a6c1-0891-480e-888b-54bced69a7f3\") " pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.589566 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.589525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqj26\" (UniqueName: \"kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26\") pod \"authorino-7c84b58b4b-dkwj4\" (UID: \"40079581-6425-4713-b0b9-affc66dd1501\") " pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:49.690950 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.690871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqj26\" (UniqueName: \"kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26\") pod \"authorino-7c84b58b4b-dkwj4\" (UID: \"40079581-6425-4713-b0b9-affc66dd1501\") " pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:49.698949 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.698911    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqj26\" (UniqueName: \"kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26\") pod \"authorino-7c84b58b4b-dkwj4\" (UID: \"40079581-6425-4713-b0b9-affc66dd1501\") " pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:49.706665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.706637    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:49.706915 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.706900    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:49.734948 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.734918    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:17:49.737556 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.737534    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:49.739989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.739966    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 21:17:49.745483 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.745237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:17:49.844971 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.844939    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:49.848031 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:17:49.848004    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40079581_6425_4713_b0b9_affc66dd1501.slice/crio-bc198f3f887ad7675979ffacdecf3486cae35652645c7e5f6d0ef80bda3390d6 WatchSource:0}: Error finding container bc198f3f887ad7675979ffacdecf3486cae35652645c7e5f6d0ef80bda3390d6: Status 404 returned error can't find the container with id bc198f3f887ad7675979ffacdecf3486cae35652645c7e5f6d0ef80bda3390d6
Jul 22 21:17:49.849656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.849631    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.859626 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.859607    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:49.892558 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.892528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:49.892668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.892568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9tm\" (UniqueName: \"kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:49.993599 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.993564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkrs2\" (UniqueName: \"kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2\") pod \"54a7a6c1-0891-480e-888b-54bced69a7f3\" (UID: \"54a7a6c1-0891-480e-888b-54bced69a7f3\") "
Jul 22 21:17:49.993783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.993749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:49.993783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.993778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9tm\" (UniqueName: \"kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:49.995952 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.995927    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2" (OuterVolumeSpecName: "kube-api-access-wkrs2") pod "54a7a6c1-0891-480e-888b-54bced69a7f3" (UID: "54a7a6c1-0891-480e-888b-54bced69a7f3"). InnerVolumeSpecName "kube-api-access-wkrs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:17:49.996246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:49.996228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:50.002020 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.001998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9tm\" (UniqueName: \"kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm\") pod \"authorino-54867d857d-857gl\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") " pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:50.048627 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.048594    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:17:50.095249 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.095212    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkrs2\" (UniqueName: \"kubernetes.io/projected/54a7a6c1-0891-480e-888b-54bced69a7f3-kube-api-access-wkrs2\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:17:50.178618 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.178589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:17:50.180577 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:17:50.180547    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod408ffbe9_3fee_4a17_b52f_99f99e16a345.slice/crio-a9f4e301c981475ba52bb58dc7ca9dfaa92017d4d4d017a310b06c5ff8730e60 WatchSource:0}: Error finding container a9f4e301c981475ba52bb58dc7ca9dfaa92017d4d4d017a310b06c5ff8730e60: Status 404 returned error can't find the container with id a9f4e301c981475ba52bb58dc7ca9dfaa92017d4d4d017a310b06c5ff8730e60
Jul 22 21:17:50.855737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.855702    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" event={"ID":"40079581-6425-4713-b0b9-affc66dd1501","Type":"ContainerStarted","Data":"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"}
Jul 22 21:17:50.855945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.855748    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" event={"ID":"40079581-6425-4713-b0b9-affc66dd1501","Type":"ContainerStarted","Data":"bc198f3f887ad7675979ffacdecf3486cae35652645c7e5f6d0ef80bda3390d6"}
Jul 22 21:17:50.855945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.855755    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" podUID="40079581-6425-4713-b0b9-affc66dd1501" containerName="authorino" containerID="cri-o://9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84" gracePeriod=30
Jul 22 21:17:50.857495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.857469    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptkv4"
Jul 22 21:17:50.857605 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.857489    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54867d857d-857gl" event={"ID":"408ffbe9-3fee-4a17-b52f-99f99e16a345","Type":"ContainerStarted","Data":"3ed2beb78542c1e257f4c30af64fa1d4f0fb2ba789a3b7f42145a0719e1a1964"}
Jul 22 21:17:50.857605 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.857526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54867d857d-857gl" event={"ID":"408ffbe9-3fee-4a17-b52f-99f99e16a345","Type":"ContainerStarted","Data":"a9f4e301c981475ba52bb58dc7ca9dfaa92017d4d4d017a310b06c5ff8730e60"}
Jul 22 21:17:50.871368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.871324    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" podStartSLOduration=1.416708016 podStartE2EDuration="1.871310658s" totalImagesPullingTime="454.602642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:50.86971795 +0000 UTC m=+732.207332827" watchObservedRunningTime="2026-07-22 21:17:50.871310658 +0000 UTC m=+732.208925535"
Jul 22 21:17:50.937551 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.937491    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54867d857d-857gl" podStartSLOduration=1.477402646 podStartE2EDuration="1.937469957s" totalImagesPullingTime="460.067311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:50.888044115 +0000 UTC m=+732.225658994" watchObservedRunningTime="2026-07-22 21:17:50.937469957 +0000 UTC m=+732.275084837"
Jul 22 21:17:50.944151 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.944098    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptkv4"]
Jul 22 21:17:50.948371 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:50.948343    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptkv4"]
Jul 22 21:17:51.097578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.097550    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:51.150470 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.150429    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a7a6c1-0891-480e-888b-54bced69a7f3" path="/var/lib/kubelet/pods/54a7a6c1-0891-480e-888b-54bced69a7f3/volumes"
Jul 22 21:17:51.206619 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.206531    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqj26\" (UniqueName: \"kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26\") pod \"40079581-6425-4713-b0b9-affc66dd1501\" (UID: \"40079581-6425-4713-b0b9-affc66dd1501\") "
Jul 22 21:17:51.208813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.208780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26" (OuterVolumeSpecName: "kube-api-access-cqj26") pod "40079581-6425-4713-b0b9-affc66dd1501" (UID: "40079581-6425-4713-b0b9-affc66dd1501"). InnerVolumeSpecName "kube-api-access-cqj26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:17:51.307506 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.307466    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqj26\" (UniqueName: \"kubernetes.io/projected/40079581-6425-4713-b0b9-affc66dd1501-kube-api-access-cqj26\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:17:51.863665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.863577    2569 generic.go:356] "Generic (PLEG): container finished" podID="40079581-6425-4713-b0b9-affc66dd1501" containerID="9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84" exitCode=0
Jul 22 21:17:51.863665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.863626    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4"
Jul 22 21:17:51.863866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.863667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" event={"ID":"40079581-6425-4713-b0b9-affc66dd1501","Type":"ContainerDied","Data":"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"}
Jul 22 21:17:51.863866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.863716    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c84b58b4b-dkwj4" event={"ID":"40079581-6425-4713-b0b9-affc66dd1501","Type":"ContainerDied","Data":"bc198f3f887ad7675979ffacdecf3486cae35652645c7e5f6d0ef80bda3390d6"}
Jul 22 21:17:51.863866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.863738    2569 scope.go:117] "RemoveContainer" containerID="9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"
Jul 22 21:17:51.872359 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.872339    2569 scope.go:117] "RemoveContainer" containerID="9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"
Jul 22 21:17:51.872662 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:17:51.872641    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84\": container with ID starting with 9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84 not found: ID does not exist" containerID="9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"
Jul 22 21:17:51.872717 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.872672    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84"} err="failed to get container status \"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84\": rpc error: code = NotFound desc = could not find container \"9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84\": container with ID starting with 9f7e86116a5830eb8411b00f62bbee2bc3a6e130db1367da0187d4145948ed84 not found: ID does not exist"
Jul 22 21:17:51.885236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.885210    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:51.893368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:51.893345    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c84b58b4b-dkwj4"]
Jul 22 21:17:53.151229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:53.151195    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40079581-6425-4713-b0b9-affc66dd1501" path="/var/lib/kubelet/pods/40079581-6425-4713-b0b9-affc66dd1501/volumes"
Jul 22 21:17:55.546895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:55.546853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:55.649714 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:55.649680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:55.731231 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:55.731192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:58.630524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:58.630488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:17:58.729264 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:17:58.729231    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:27.665105 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:27.665066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:32.552775 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:32.552742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:32.665886 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:32.665851    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:33.031245 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.031206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:33.243973 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.243939    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:33.478306 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.478222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:33.553309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.553278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:33.613943 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.613911    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p2f96"]
Jul 22 21:18:33.614278 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.614264    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40079581-6425-4713-b0b9-affc66dd1501" containerName="authorino"
Jul 22 21:18:33.614327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.614283    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="40079581-6425-4713-b0b9-affc66dd1501" containerName="authorino"
Jul 22 21:18:33.614361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.614336    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="40079581-6425-4713-b0b9-affc66dd1501" containerName="authorino"
Jul 22 21:18:33.617368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.617337    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.620162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.620065    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q6v5r\""
Jul 22 21:18:33.620162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.620084    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 21:18:33.625495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.624982    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p2f96"]
Jul 22 21:18:33.745231 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.745193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0adb0dc-70b6-4cae-b882-be3c57576650-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.745435 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.745335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqw8m\" (UniqueName: \"kubernetes.io/projected/d0adb0dc-70b6-4cae-b882-be3c57576650-kube-api-access-mqw8m\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.846085 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.846039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqw8m\" (UniqueName: \"kubernetes.io/projected/d0adb0dc-70b6-4cae-b882-be3c57576650-kube-api-access-mqw8m\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.846372 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.846099    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0adb0dc-70b6-4cae-b882-be3c57576650-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.846898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.846879    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0adb0dc-70b6-4cae-b882-be3c57576650-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.854003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.853974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqw8m\" (UniqueName: \"kubernetes.io/projected/d0adb0dc-70b6-4cae-b882-be3c57576650-kube-api-access-mqw8m\") pod \"payload-processing-5bf47cd988-p2f96\" (UID: \"d0adb0dc-70b6-4cae-b882-be3c57576650\") " pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:33.930148 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:33.930104    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:34.067348 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:34.067323    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p2f96"]
Jul 22 21:18:34.069785 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:18:34.069757    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0adb0dc_70b6_4cae_b882_be3c57576650.slice/crio-801380973febb6d1f1d93148e26b534b89664a9f6affa17da1eea3695204ca23 WatchSource:0}: Error finding container 801380973febb6d1f1d93148e26b534b89664a9f6affa17da1eea3695204ca23: Status 404 returned error can't find the container with id 801380973febb6d1f1d93148e26b534b89664a9f6affa17da1eea3695204ca23
Jul 22 21:18:35.055449 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:35.055412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96" event={"ID":"d0adb0dc-70b6-4cae-b882-be3c57576650","Type":"ContainerStarted","Data":"801380973febb6d1f1d93148e26b534b89664a9f6affa17da1eea3695204ca23"}
Jul 22 21:18:37.066911 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:37.066873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96" event={"ID":"d0adb0dc-70b6-4cae-b882-be3c57576650","Type":"ContainerStarted","Data":"923b848e01775f8a9f1a4e400bec4bf49f1c0a0075eb9770452ca0aa1f4dbc73"}
Jul 22 21:18:37.067401 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:37.066988    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:18:37.083198 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:37.083151    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96" podStartSLOduration=1.8355144289999998 podStartE2EDuration="4.083115775s" totalImagesPullingTime="2.247601346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:18:37.082263019 +0000 UTC m=+778.419877896" watchObservedRunningTime="2026-07-22 21:18:37.083115775 +0000 UTC m=+778.420730652"
Jul 22 21:18:42.946532 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:42.946499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:43.043453 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:43.043422    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:18:48.073920 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:18:48.073894    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-p2f96"
Jul 22 21:19:04.954014 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.953982    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"]
Jul 22 21:19:04.956680 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.956661    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:04.960401 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.960380    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 21:19:04.960541 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.960388    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 21:19:04.960646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.960390    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tm5ws\""
Jul 22 21:19:04.960646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.960409    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 21:19:04.965338 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.965315    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"]
Jul 22 21:19:04.981186 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:04.981154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:19:05.007205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.007357 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007293    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.007474 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48sfg\" (UniqueName: \"kubernetes.io/projected/894aca74-531d-420f-a959-d6a7a397ba6c-kube-api-access-48sfg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.007536 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.007671 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.007736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.007716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/894aca74-531d-420f-a959-d6a7a397ba6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108356 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108388    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/894aca74-531d-420f-a959-d6a7a397ba6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108640    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48sfg\" (UniqueName: \"kubernetes.io/projected/894aca74-531d-420f-a959-d6a7a397ba6c-kube-api-access-48sfg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108793    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.108885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.108849    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.109061 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.109036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.110794 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.110772    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/894aca74-531d-420f-a959-d6a7a397ba6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.111077 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.111054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/894aca74-531d-420f-a959-d6a7a397ba6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.116298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.116277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48sfg\" (UniqueName: \"kubernetes.io/projected/894aca74-531d-420f-a959-d6a7a397ba6c-kube-api-access-48sfg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht\" (UID: \"894aca74-531d-420f-a959-d6a7a397ba6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.267271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.267241    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:05.400059 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:05.400034    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"]
Jul 22 21:19:05.402452 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:19:05.402410    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894aca74_531d_420f_a959_d6a7a397ba6c.slice/crio-5f488f963f1018c69cbac7fa6722db622213c4ece5582d19ecbb7180cd468b0a WatchSource:0}: Error finding container 5f488f963f1018c69cbac7fa6722db622213c4ece5582d19ecbb7180cd468b0a: Status 404 returned error can't find the container with id 5f488f963f1018c69cbac7fa6722db622213c4ece5582d19ecbb7180cd468b0a
Jul 22 21:19:06.202910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:06.202875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht" event={"ID":"894aca74-531d-420f-a959-d6a7a397ba6c","Type":"ContainerStarted","Data":"5f488f963f1018c69cbac7fa6722db622213c4ece5582d19ecbb7180cd468b0a"}
Jul 22 21:19:07.209370 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:07.209330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht" event={"ID":"894aca74-531d-420f-a959-d6a7a397ba6c","Type":"ContainerStarted","Data":"f2d9cdc9e51e405a1f3200c1cf055d6f5c1f6045c7e361b2587b4a759abd0714"}
Jul 22 21:19:07.230864 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:07.230810    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht" podStartSLOduration=1.98423726 podStartE2EDuration="3.230792134s" totalImagesPullingTime="1.246554874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:19:07.22954919 +0000 UTC m=+808.567164080" watchObservedRunningTime="2026-07-22 21:19:07.230792134 +0000 UTC m=+808.568407010"
Jul 22 21:19:15.267988 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:15.267950    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:15.268413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:15.268045    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:15.280010 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:15.279988    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:16.259851 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:16.259825    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht"
Jul 22 21:19:24.272867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:24.272830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:19:43.156559 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:43.156502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:19:55.845438 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.845399    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"]
Jul 22 21:19:55.851326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.851305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.853856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.853833    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 21:19:55.860062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.860041    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"]
Jul 22 21:19:55.887904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.887879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:19:55.932064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.932064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.932310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfvdk\" (UniqueName: \"kubernetes.io/projected/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-kube-api-access-vfvdk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.932310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.932310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:55.932427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:55.932335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033222 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033222 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfvdk\" (UniqueName: \"kubernetes.io/projected/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-kube-api-access-vfvdk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033597    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033643    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.033758 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.033686    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.035750 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.035730    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.035990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.035974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.040862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.040841    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfvdk\" (UniqueName: \"kubernetes.io/projected/cf5c078d-553b-405c-b1a2-cbcb0a4f6758-kube-api-access-vfvdk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gjbcq\" (UID: \"cf5c078d-553b-405c-b1a2-cbcb0a4f6758\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.161881 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.161776    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:19:56.296474 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.296453    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"]
Jul 22 21:19:56.298332 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:19:56.298305    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5c078d_553b_405c_b1a2_cbcb0a4f6758.slice/crio-6ef287d50dec7d1d0998d3a78569a2a8a4a1cc0945258681a07e45392840ac59 WatchSource:0}: Error finding container 6ef287d50dec7d1d0998d3a78569a2a8a4a1cc0945258681a07e45392840ac59: Status 404 returned error can't find the container with id 6ef287d50dec7d1d0998d3a78569a2a8a4a1cc0945258681a07e45392840ac59
Jul 22 21:19:56.435792 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:56.435709    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq" event={"ID":"cf5c078d-553b-405c-b1a2-cbcb0a4f6758","Type":"ContainerStarted","Data":"6ef287d50dec7d1d0998d3a78569a2a8a4a1cc0945258681a07e45392840ac59"}
Jul 22 21:19:57.442932 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:57.442899    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq" event={"ID":"cf5c078d-553b-405c-b1a2-cbcb0a4f6758","Type":"ContainerStarted","Data":"a23d2cc5ea2070b734fb742b69fd27adf28bfbc60d1527c4dd59ad6bea820120"}
Jul 22 21:19:57.460360 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:19:57.460312    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq" podStartSLOduration=2.2515185730000002 podStartE2EDuration="2.460296715s" totalImagesPullingTime="208.778142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:19:57.459594674 +0000 UTC m=+858.797209552" watchObservedRunningTime="2026-07-22 21:19:57.460296715 +0000 UTC m=+858.797911592"
Jul 22 21:20:00.463599 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:00.463555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:20:06.162661 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:06.162613    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:20:06.163174 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:06.162698    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:20:06.174866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:06.174837    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:20:06.494304 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:06.494268    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gjbcq"
Jul 22 21:20:20.730320 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:20.730246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:20:25.747884 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:25.747845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:20:39.120518 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:39.120436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:20:39.122309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:20:39.122278    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:21:27.772594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:27.772548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:21:28.716512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:28.716479    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:21:28.716697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:28.716673    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-54867d857d-857gl" podUID="408ffbe9-3fee-4a17-b52f-99f99e16a345" containerName="authorino" containerID="cri-o://3ed2beb78542c1e257f4c30af64fa1d4f0fb2ba789a3b7f42145a0719e1a1964" gracePeriod=30
Jul 22 21:21:28.859234 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:28.859200    2569 generic.go:356] "Generic (PLEG): container finished" podID="408ffbe9-3fee-4a17-b52f-99f99e16a345" containerID="3ed2beb78542c1e257f4c30af64fa1d4f0fb2ba789a3b7f42145a0719e1a1964" exitCode=0
Jul 22 21:21:28.859722 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:28.859276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54867d857d-857gl" event={"ID":"408ffbe9-3fee-4a17-b52f-99f99e16a345","Type":"ContainerDied","Data":"3ed2beb78542c1e257f4c30af64fa1d4f0fb2ba789a3b7f42145a0719e1a1964"}
Jul 22 21:21:28.982668 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:28.982643    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:21:29.094022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.093983    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj9tm\" (UniqueName: \"kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm\") pod \"408ffbe9-3fee-4a17-b52f-99f99e16a345\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") "
Jul 22 21:21:29.094229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.094035    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert\") pod \"408ffbe9-3fee-4a17-b52f-99f99e16a345\" (UID: \"408ffbe9-3fee-4a17-b52f-99f99e16a345\") "
Jul 22 21:21:29.096465 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.096434    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm" (OuterVolumeSpecName: "kube-api-access-bj9tm") pod "408ffbe9-3fee-4a17-b52f-99f99e16a345" (UID: "408ffbe9-3fee-4a17-b52f-99f99e16a345"). InnerVolumeSpecName "kube-api-access-bj9tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:21:29.104683 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.104648    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "408ffbe9-3fee-4a17-b52f-99f99e16a345" (UID: "408ffbe9-3fee-4a17-b52f-99f99e16a345"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:21:29.195545 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.195504    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj9tm\" (UniqueName: \"kubernetes.io/projected/408ffbe9-3fee-4a17-b52f-99f99e16a345-kube-api-access-bj9tm\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:21:29.195545 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.195539    2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/408ffbe9-3fee-4a17-b52f-99f99e16a345-tls-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:21:29.433236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.433203    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:21:29.864729 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.864692    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54867d857d-857gl"
Jul 22 21:21:29.865214 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.864695    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54867d857d-857gl" event={"ID":"408ffbe9-3fee-4a17-b52f-99f99e16a345","Type":"ContainerDied","Data":"a9f4e301c981475ba52bb58dc7ca9dfaa92017d4d4d017a310b06c5ff8730e60"}
Jul 22 21:21:29.865214 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.864810    2569 scope.go:117] "RemoveContainer" containerID="3ed2beb78542c1e257f4c30af64fa1d4f0fb2ba789a3b7f42145a0719e1a1964"
Jul 22 21:21:29.884810 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.884786    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:21:29.888634 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:29.888607    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54867d857d-857gl"]
Jul 22 21:21:31.150862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:31.150831    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408ffbe9-3fee-4a17-b52f-99f99e16a345" path="/var/lib/kubelet/pods/408ffbe9-3fee-4a17-b52f-99f99e16a345/volumes"
Jul 22 21:21:51.242411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:51.242347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:21:51.340225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:51.340180    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:21:57.552686 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:21:57.552652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:22:39.233515 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:22:39.233483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:22:39.292977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:22:39.292935    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:23:33.811430 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:23:33.811310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:23:35.064682 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:23:35.064616    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:23:47.021146 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:23:47.021076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:23:47.127323 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:23:47.127291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:08.380020 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:08.379980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:08.516766 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:08.516735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:08.618834 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:08.618792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:14.402913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:14.402866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:14.453537 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:14.453500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:14.533384 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:14.533339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:14.631115 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:14.631068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:14.741330 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:14.741291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:20.412876 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:20.412843    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:24:20.465674 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:24:20.465641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:25:02.264647 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:25:02.264549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:25:39.147562 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:25:39.147532    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:25:39.149621 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:25:39.149599    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:27:09.264977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:27:09.264943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:27:10.642710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:27:10.642672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:28:11.141402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:11.141321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:28:15.907771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:15.907733    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:28:15.908268 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:15.907924    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerName="manager" containerID="cri-o://ac6a3249396dfcbc3cd8a4de16bb2d878fef463e210b48eeab6a05ea4fb4fe80" gracePeriod=10
Jul 22 21:28:18.583576 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.583529    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.27:8081/readyz\": dial tcp 10.133.0.27:8081: connect: connection refused"
Jul 22 21:28:18.679198 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.679169    2569 generic.go:356] "Generic (PLEG): container finished" podID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerID="ac6a3249396dfcbc3cd8a4de16bb2d878fef463e210b48eeab6a05ea4fb4fe80" exitCode=0
Jul 22 21:28:18.679354 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.679220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" event={"ID":"2819a8c1-b58f-464a-be89-9a98ffb9d20f","Type":"ContainerDied","Data":"ac6a3249396dfcbc3cd8a4de16bb2d878fef463e210b48eeab6a05ea4fb4fe80"}
Jul 22 21:28:18.755402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.755372    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:28:18.897592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.897510    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume\") pod \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") "
Jul 22 21:28:18.897739 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.897604    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9rxc\" (UniqueName: \"kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc\") pod \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\" (UID: \"2819a8c1-b58f-464a-be89-9a98ffb9d20f\") "
Jul 22 21:28:18.897962 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.897938    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2819a8c1-b58f-464a-be89-9a98ffb9d20f" (UID: "2819a8c1-b58f-464a-be89-9a98ffb9d20f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:28:18.899753 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.899730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc" (OuterVolumeSpecName: "kube-api-access-m9rxc") pod "2819a8c1-b58f-464a-be89-9a98ffb9d20f" (UID: "2819a8c1-b58f-464a-be89-9a98ffb9d20f"). InnerVolumeSpecName "kube-api-access-m9rxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:28:18.998546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.998505    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2819a8c1-b58f-464a-be89-9a98ffb9d20f-extensions-socket-volume\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:28:18.998546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:18.998537    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9rxc\" (UniqueName: \"kubernetes.io/projected/2819a8c1-b58f-464a-be89-9a98ffb9d20f-kube-api-access-m9rxc\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:28:19.686141 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:19.686100    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn" event={"ID":"2819a8c1-b58f-464a-be89-9a98ffb9d20f","Type":"ContainerDied","Data":"6e0d1a6c9026e2bab1a079c88514d84d19a22542ba577a6576f545995229833c"}
Jul 22 21:28:19.686575 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:19.686179    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"
Jul 22 21:28:19.686575 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:19.686204    2569 scope.go:117] "RemoveContainer" containerID="ac6a3249396dfcbc3cd8a4de16bb2d878fef463e210b48eeab6a05ea4fb4fe80"
Jul 22 21:28:19.704026 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:19.703999    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:28:19.708372 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:19.708353    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zb5gn"]
Jul 22 21:28:21.150302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:28:21.150272    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" path="/var/lib/kubelet/pods/2819a8c1-b58f-464a-be89-9a98ffb9d20f/volumes"
Jul 22 21:29:17.006357 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006320    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"]
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006634    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408ffbe9-3fee-4a17-b52f-99f99e16a345" containerName="authorino"
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006647    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="408ffbe9-3fee-4a17-b52f-99f99e16a345" containerName="authorino"
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006657    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerName="manager"
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006662    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerName="manager"
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006720    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="408ffbe9-3fee-4a17-b52f-99f99e16a345" containerName="authorino"
Jul 22 21:29:17.006823 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.006728    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2819a8c1-b58f-464a-be89-9a98ffb9d20f" containerName="manager"
Jul 22 21:29:17.009671 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.009650    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.012578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.012557    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zhkzn\""
Jul 22 21:29:17.026531 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.026504    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"]
Jul 22 21:29:17.056920 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.056887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69p5\" (UniqueName: \"kubernetes.io/projected/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-kube-api-access-n69p5\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.057107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.056960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.158152 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.158090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69p5\" (UniqueName: \"kubernetes.io/projected/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-kube-api-access-n69p5\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.158328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.158194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.158622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.158595    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.167904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.167882    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69p5\" (UniqueName: \"kubernetes.io/projected/9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7-kube-api-access-n69p5\") pod \"kuadrant-operator-controller-manager-86878c769f-zvp77\" (UID: \"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.319799 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.319716    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.457444 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.457407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"]
Jul 22 21:29:17.461031 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:29:17.460996    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5e2972_f766_4e2e_8a2d_f6d2fbf2b8e7.slice/crio-4f7dfaab4955f0b349a108f2feb2266289e4dd60312f5f01aa47f71a9bd1bfd4 WatchSource:0}: Error finding container 4f7dfaab4955f0b349a108f2feb2266289e4dd60312f5f01aa47f71a9bd1bfd4: Status 404 returned error can't find the container with id 4f7dfaab4955f0b349a108f2feb2266289e4dd60312f5f01aa47f71a9bd1bfd4
Jul 22 21:29:17.941492 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.941461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77" event={"ID":"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7","Type":"ContainerStarted","Data":"0093803922aa4ed9fd39779818be1235b11ea7e9b405ee1e4cfb47dd3612710f"}
Jul 22 21:29:17.941686 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.941519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77" event={"ID":"9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7","Type":"ContainerStarted","Data":"4f7dfaab4955f0b349a108f2feb2266289e4dd60312f5f01aa47f71a9bd1bfd4"}
Jul 22 21:29:17.941686 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.941564    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:29:17.961780 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:17.961722    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77" podStartSLOduration=1.961701079 podStartE2EDuration="1.961701079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:29:17.960331635 +0000 UTC m=+1419.297946513" watchObservedRunningTime="2026-07-22 21:29:17.961701079 +0000 UTC m=+1419.299315956"
Jul 22 21:29:28.948975 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:29:28.948893    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zvp77"
Jul 22 21:30:00.149783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.149749    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"]
Jul 22 21:30:00.153409 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.153388    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"
Jul 22 21:30:00.157432 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.157412    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:30:00.163239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.163210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"
Jul 22 21:30:00.164089 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.164065    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"]
Jul 22 21:30:00.301860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.301824    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"]
Jul 22 21:30:00.305696 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:30:00.305667    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf49f30a_7f4a_4a85_84ea_9216eb2a3677.slice/crio-efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf WatchSource:0}: Error finding container efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf: Status 404 returned error can't find the container with id efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf
Jul 22 21:30:00.307578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:00.307560    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:30:01.138956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:01.138923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66" event={"ID":"df49f30a-7f4a-4a85-84ea-9216eb2a3677","Type":"ContainerStarted","Data":"efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf"}
Jul 22 21:30:03.150535 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:03.150504    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66" event={"ID":"df49f30a-7f4a-4a85-84ea-9216eb2a3677","Type":"ContainerStarted","Data":"2870eaf760b361c3712233096e7e2784a145aa57450b796b559699b5b5f9249b"}
Jul 22 21:30:03.166873 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:03.166823    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66" podStartSLOduration=0.822098321 podStartE2EDuration="3.166807371s" totalImagesPullingTime="2.34470905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:30:03.164524726 +0000 UTC m=+1464.502139604" watchObservedRunningTime="2026-07-22 21:30:03.166807371 +0000 UTC m=+1464.504422247"
Jul 22 21:30:04.156263 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:04.156225    2569 generic.go:356] "Generic (PLEG): container finished" podID="df49f30a-7f4a-4a85-84ea-9216eb2a3677" containerID="2870eaf760b361c3712233096e7e2784a145aa57450b796b559699b5b5f9249b" exitCode=0
Jul 22 21:30:04.156661 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:04.156320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66" event={"ID":"df49f30a-7f4a-4a85-84ea-9216eb2a3677","Type":"ContainerDied","Data":"2870eaf760b361c3712233096e7e2784a145aa57450b796b559699b5b5f9249b"}
Jul 22 21:30:05.295614 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:05.295583    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"
Jul 22 21:30:06.165957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:06.165921    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66" event={"ID":"df49f30a-7f4a-4a85-84ea-9216eb2a3677","Type":"ContainerDied","Data":"efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf"}
Jul 22 21:30:06.165957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:06.165942    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745930-55x66"
Jul 22 21:30:06.166236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:06.165971    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efe1639b9cd01e87ad616181fdc24ccd2c80d06ad3036b16315f945ef8c063cf"
Jul 22 21:30:39.173471 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:39.173436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:30:39.177349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:30:39.177330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:31:37.441299 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:31:37.441206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:31:59.744437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:31:59.744403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:32:05.263688 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:32:05.263638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:32:28.553615 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:32:28.553581    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:32:29.807752 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:32:29.807666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:34:21.103210 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:34:21.103101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:34:30.495795 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:34:30.495754    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:34:41.127102 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:34:41.127065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:35:37.015874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:35:37.015838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:35:39.201026 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:35:39.201002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:35:39.205959 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:35:39.205940    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:35:58.340816 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:35:58.340784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:01.346676 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:01.346642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:01.441230 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:01.441189    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:01.807815 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:01.807777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:07.649399 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:07.649360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:07.747875 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:07.747836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:07.875235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:07.875190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:08.176528 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:08.176491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:08.623233 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:08.623196    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:10.864423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:10.864389    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:10.961846 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:10.961815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:11.423420 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:11.423390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:11.531046 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:11.531013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:11.640194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:11.640162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:11.741111 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:11.741075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:36.322712 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.322675    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"]
Jul 22 21:36:36.323167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.323025    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df49f30a-7f4a-4a85-84ea-9216eb2a3677" containerName="cleanup"
Jul 22 21:36:36.323167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.323036    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="df49f30a-7f4a-4a85-84ea-9216eb2a3677" containerName="cleanup"
Jul 22 21:36:36.323167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.323106    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="df49f30a-7f4a-4a85-84ea-9216eb2a3677" containerName="cleanup"
Jul 22 21:36:36.326033 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.326017    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:36.328357 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.328337    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:36:36.328464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.328376    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:36:36.332222 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.332195    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"]
Jul 22 21:36:36.426485 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.426450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw\" (UID: \"53f95f68-3fb1-4e82-a0eb-78618850cb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:36.527188 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.527123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw\" (UID: \"53f95f68-3fb1-4e82-a0eb-78618850cb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:36.527846 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.527824    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw\" (UID: \"53f95f68-3fb1-4e82-a0eb-78618850cb01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:36.637445 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.637354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:36.977850 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:36.977820    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"]
Jul 22 21:36:36.980205 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:36:36.980173    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f95f68_3fb1_4e82_a0eb_78618850cb01.slice/crio-4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b WatchSource:0}: Error finding container 4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b: Status 404 returned error can't find the container with id 4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b
Jul 22 21:36:37.972628 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:37.972541    2569 generic.go:356] "Generic (PLEG): container finished" podID="53f95f68-3fb1-4e82-a0eb-78618850cb01" containerID="79a3f4ec818547dad96c7872eb9486bd8d475da7f23c5ad0d7b4ef19c9d62fea" exitCode=0
Jul 22 21:36:37.972628 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:37.972604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw" event={"ID":"53f95f68-3fb1-4e82-a0eb-78618850cb01","Type":"ContainerDied","Data":"79a3f4ec818547dad96c7872eb9486bd8d475da7f23c5ad0d7b4ef19c9d62fea"}
Jul 22 21:36:37.973036 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:37.972643    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw" event={"ID":"53f95f68-3fb1-4e82-a0eb-78618850cb01","Type":"ContainerStarted","Data":"4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b"}
Jul 22 21:36:39.108728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.108707    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:39.253381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.253341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca\") pod \"53f95f68-3fb1-4e82-a0eb-78618850cb01\" (UID: \"53f95f68-3fb1-4e82-a0eb-78618850cb01\") "
Jul 22 21:36:39.253663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.253642    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "53f95f68-3fb1-4e82-a0eb-78618850cb01" (UID: "53f95f68-3fb1-4e82-a0eb-78618850cb01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:36:39.354493 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.354462    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f95f68-3fb1-4e82-a0eb-78618850cb01-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:36:39.982607 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.982575    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"
Jul 22 21:36:39.982782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.982575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw" event={"ID":"53f95f68-3fb1-4e82-a0eb-78618850cb01","Type":"ContainerDied","Data":"4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b"}
Jul 22 21:36:39.982782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:39.982749    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bf2968b514ebcb09fabbaf0c076b16474586d91cfb6bcd696bc044278d4d54b"
Jul 22 21:36:46.757411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:46.757378    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:51.405298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:51.405252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:51.407083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:51.407055    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"]
Jul 22 21:36:51.408686 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:51.408668    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-69774d8e-kvvkw"]
Jul 22 21:36:51.564947 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:51.564899    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:51.806754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:51.806721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:52.118908 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.118822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:52.215770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.215735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:52.314485 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.314449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:52.605845 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.605811    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:36:52.606259 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.606190    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f95f68-3fb1-4e82-a0eb-78618850cb01" containerName="revoke-keys"
Jul 22 21:36:52.606259 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.606204    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f95f68-3fb1-4e82-a0eb-78618850cb01" containerName="revoke-keys"
Jul 22 21:36:52.606367 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.606282    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f95f68-3fb1-4e82-a0eb-78618850cb01" containerName="revoke-keys"
Jul 22 21:36:52.609305 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.609287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.612257 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.612237    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-13623ccb-gw-openshift-default-dockercfg-76mm8\""
Jul 22 21:36:52.625403 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.625376    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:36:52.634200 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.634175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:52.774058 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774016    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64vpq\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774058 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774064    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774119    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774479 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.774479 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.774334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875679 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875679 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875640    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875679 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875842    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.875944 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.875905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64vpq\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.876336 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.876021    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.876336 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.876147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.876336 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.876273    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.876488 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.876398    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.876762 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.876737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.878179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.878151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.878402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.878384    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.884491 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.884467    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64vpq\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.884805 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.884783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token\") pod \"e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") " pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:52.920975 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:52.920939    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:53.031885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:53.031793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:53.070257 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:53.070234    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:36:53.072056 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:36:53.072018    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8feb802b_7268_48f4_b31f_c0d286fb204c.slice/crio-96babac0182d8091d36e9465e5140490f52589c469aa51dbb19a9dbff74fd8b1 WatchSource:0}: Error finding container 96babac0182d8091d36e9465e5140490f52589c469aa51dbb19a9dbff74fd8b1: Status 404 returned error can't find the container with id 96babac0182d8091d36e9465e5140490f52589c469aa51dbb19a9dbff74fd8b1
Jul 22 21:36:53.074482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:53.074465    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:36:53.151259 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:53.151178    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f95f68-3fb1-4e82-a0eb-78618850cb01" path="/var/lib/kubelet/pods/53f95f68-3fb1-4e82-a0eb-78618850cb01/volumes"
Jul 22 21:36:54.048694 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:54.048651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerStarted","Data":"96babac0182d8091d36e9465e5140490f52589c469aa51dbb19a9dbff74fd8b1"}
Jul 22 21:36:57.340967 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:57.340922    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:36:57.341271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:57.341026    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:36:57.341271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:57.341061    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:36:58.071373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:58.071338    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerStarted","Data":"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"}
Jul 22 21:36:58.094383 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:58.094317    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podStartSLOduration=1.828270935 podStartE2EDuration="6.094294204s" totalImagesPullingTime="4.266023269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:36:58.093019894 +0000 UTC m=+1879.430634795" watchObservedRunningTime="2026-07-22 21:36:58.094294204 +0000 UTC m=+1879.431909082"
Jul 22 21:36:58.921556 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:58.921516    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:58.926512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:58.926487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:59.076147 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:59.076092    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:59.076953 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:59.076932    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:36:59.541691 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:59.541654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:59.735546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:59.735465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:36:59.851242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:36:59.851152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:00.344110 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:00.344072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:00.445797 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:00.445760    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:10.136467 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.136434    2569 generic.go:356] "Generic (PLEG): container finished" podID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerID="ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d" exitCode=0
Jul 22 21:37:10.136941 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.136513    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerDied","Data":"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"}
Jul 22 21:37:10.136941 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.136890    2569 scope.go:117] "RemoveContainer" containerID="ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"
Jul 22 21:37:10.138843 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.138808    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:10.138916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.138885    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:10.138955 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:10.138940    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:11.143876 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:11.143842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerStarted","Data":"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"}
Jul 22 21:37:11.921548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:11.921509    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:11.922778 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:11.922748    2569 patch_prober.go:28] interesting pod/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:37:11.922901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:11.922803    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 21:37:12.921495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:12.921460    2569 patch_prober.go:28] interesting pod/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:37:12.921877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:12.921535    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 21:37:13.921426 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:13.921385    2569 patch_prober.go:28] interesting pod/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:37:13.921608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:13.921446    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 21:37:14.076091 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:14.076060    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:14.922365 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:14.922325    2569 patch_prober.go:28] interesting pod/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 21:37:14.922796 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:14.922387    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 21:37:15.926293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:15.926263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:15.927181 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:15.927161    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:24.593296 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.593248    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"]
Jul 22 21:37:24.600657 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.600631    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:24.603512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.603490    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:37:24.603670 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.603581    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:37:24.605410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.605379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"]
Jul 22 21:37:24.741179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.741141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7\" (UID: \"ada4e6f7-31d2-47bb-9841-473245305807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:24.842472 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.842421    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7\" (UID: \"ada4e6f7-31d2-47bb-9841-473245305807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:24.843070 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.843049    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7\" (UID: \"ada4e6f7-31d2-47bb-9841-473245305807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:24.913663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:24.913582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:25.051430 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:25.051407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"]
Jul 22 21:37:25.054099 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:37:25.054072    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada4e6f7_31d2_47bb_9841_473245305807.slice/crio-436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db WatchSource:0}: Error finding container 436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db: Status 404 returned error can't find the container with id 436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db
Jul 22 21:37:25.212372 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:25.212338    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7" event={"ID":"ada4e6f7-31d2-47bb-9841-473245305807","Type":"ContainerStarted","Data":"436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db"}
Jul 22 21:37:26.218793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:26.218704    2569 generic.go:356] "Generic (PLEG): container finished" podID="ada4e6f7-31d2-47bb-9841-473245305807" containerID="f51f9ecb1dbf8e2586059e758487f28c50b873f06e1a77db66a5f8dae805db4a" exitCode=0
Jul 22 21:37:26.219209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:26.218800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7" event={"ID":"ada4e6f7-31d2-47bb-9841-473245305807","Type":"ContainerDied","Data":"f51f9ecb1dbf8e2586059e758487f28c50b873f06e1a77db66a5f8dae805db4a"}
Jul 22 21:37:27.363882 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:27.363855    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:27.464656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:27.464621    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca\") pod \"ada4e6f7-31d2-47bb-9841-473245305807\" (UID: \"ada4e6f7-31d2-47bb-9841-473245305807\") "
Jul 22 21:37:27.464993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:27.464972    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ada4e6f7-31d2-47bb-9841-473245305807" (UID: "ada4e6f7-31d2-47bb-9841-473245305807"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:27.566022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:27.565989    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ada4e6f7-31d2-47bb-9841-473245305807-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:28.234191 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:28.234157    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"
Jul 22 21:37:28.234399 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:28.234189    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7" event={"ID":"ada4e6f7-31d2-47bb-9841-473245305807","Type":"ContainerDied","Data":"436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db"}
Jul 22 21:37:28.234399 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:28.234260    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="436d85d82a8a09e0430c2249b6f41e7b83fe204c1da8650ae034e1174489a7db"
Jul 22 21:37:35.114625 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:35.114599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:39.670327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.670288    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"]
Jul 22 21:37:39.674205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.674173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:39.674791 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.674771    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-13623ccb-nv5d7"]
Jul 22 21:37:39.801375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.801337    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:37:39.801611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.801583    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy" containerID="cri-o://b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a" gracePeriod=30
Jul 22 21:37:39.829893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:39.829859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:40.136740 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.136693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:40.584314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.584270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:40.597402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.597373    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:37:40.597743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.597730    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada4e6f7-31d2-47bb-9841-473245305807" containerName="revoke-keys"
Jul 22 21:37:40.597787 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.597745    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada4e6f7-31d2-47bb-9841-473245305807" containerName="revoke-keys"
Jul 22 21:37:40.597824 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.597809    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada4e6f7-31d2-47bb-9841-473245305807" containerName="revoke-keys"
Jul 22 21:37:40.601906 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.601886    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.605156 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.605111    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8712ba9a-openshift-default-dockercfg-z7tpw\""
Jul 22 21:37:40.618349 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.618324    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:37:40.682318 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxptp\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.682747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.682730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.689715 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.689688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:40.784110 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784142    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxptp\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784790 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.784911 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.784803    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.785058 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.785018    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.785058 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.785038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.785242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.785061    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.785891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.785868    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:40.787189 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.787167    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.787323 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.787306    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.794558 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.794528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxptp\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.794690 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.794640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token\") pod \"e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") " pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:40.916912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:40.916819    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:41.057026 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.057000    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:37:41.059031 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:37:41.059004    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67783ea3_2b4d_4eb2_ba67_485677ad1a03.slice/crio-ea560c90e071c1f8d564eb6582fae3ed54c76cfa52af9332efc5951496a7ed90 WatchSource:0}: Error finding container ea560c90e071c1f8d564eb6582fae3ed54c76cfa52af9332efc5951496a7ed90: Status 404 returned error can't find the container with id ea560c90e071c1f8d564eb6582fae3ed54c76cfa52af9332efc5951496a7ed90
Jul 22 21:37:41.061786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.061742    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:41.061856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.061811    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:41.061856 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.061840    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:41.151324 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.151290    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada4e6f7-31d2-47bb-9841-473245305807" path="/var/lib/kubelet/pods/ada4e6f7-31d2-47bb-9841-473245305807/volumes"
Jul 22 21:37:41.297664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.297626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerStarted","Data":"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"}
Jul 22 21:37:41.297875 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.297690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerStarted","Data":"ea560c90e071c1f8d564eb6582fae3ed54c76cfa52af9332efc5951496a7ed90"}
Jul 22 21:37:41.323076 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.323014    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podStartSLOduration=1.322992522 podStartE2EDuration="1.322992522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:37:41.32068685 +0000 UTC m=+1922.658301729" watchObservedRunningTime="2026-07-22 21:37:41.322992522 +0000 UTC m=+1922.660607401"
Jul 22 21:37:41.917388 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:41.917348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:42.734677 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:42.734630    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:42.832167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:42.832118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:42.931328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:42.931283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:42.933710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:42.933686    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:43.188468 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:43.188370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:43.307438 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:43.307409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:43.308384 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:43.308364    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:43.432568 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:43.432527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:43.534575 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:43.534539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:37:45.052743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.052719    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:45.225217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225100    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225162    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225188    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225210    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64vpq\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225228    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225262    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225292    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225322    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225358    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert\") pod \"8feb802b-7268-48f4-b31f-c0d286fb204c\" (UID: \"8feb802b-7268-48f4-b31f-c0d286fb204c\") "
Jul 22 21:37:45.225563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225421    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:45.225869 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225653    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.225869 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225805    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:45.225869 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225803    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:45.226229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.225937    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:45.226592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.226567    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:45.227731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.227702    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:45.227731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.227708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:37:45.227865 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.227756    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq" (OuterVolumeSpecName: "kube-api-access-64vpq") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "kube-api-access-64vpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:45.227865 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.227790    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8feb802b-7268-48f4-b31f-c0d286fb204c" (UID: "8feb802b-7268-48f4-b31f-c0d286fb204c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:37:45.318025 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.317994    2569 generic.go:356] "Generic (PLEG): container finished" podID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerID="b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a" exitCode=0
Jul 22 21:37:45.318229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.318054    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"
Jul 22 21:37:45.318229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.318081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerDied","Data":"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"}
Jul 22 21:37:45.318229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.318162    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l" event={"ID":"8feb802b-7268-48f4-b31f-c0d286fb204c","Type":"ContainerDied","Data":"96babac0182d8091d36e9465e5140490f52589c469aa51dbb19a9dbff74fd8b1"}
Jul 22 21:37:45.318229 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.318195    2569 scope.go:117] "RemoveContainer" containerID="b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"
Jul 22 21:37:45.326120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326093    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326121    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326150    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326166    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8feb802b-7268-48f4-b31f-c0d286fb204c-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326178    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326189    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326199    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64vpq\" (UniqueName: \"kubernetes.io/projected/8feb802b-7268-48f4-b31f-c0d286fb204c-kube-api-access-64vpq\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.326322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.326211    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8feb802b-7268-48f4-b31f-c0d286fb204c-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:37:45.328208 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.327981    2569 scope.go:117] "RemoveContainer" containerID="ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"
Jul 22 21:37:45.336770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.336753    2569 scope.go:117] "RemoveContainer" containerID="b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"
Jul 22 21:37:45.337026 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:37:45.337004    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a\": container with ID starting with b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a not found: ID does not exist" containerID="b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"
Jul 22 21:37:45.337068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.337036    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a"} err="failed to get container status \"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a\": rpc error: code = NotFound desc = could not find container \"b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a\": container with ID starting with b51c703be144fcc5b79e9e3bc9e018d150e8215506540dd134698ffd02d8d01a not found: ID does not exist"
Jul 22 21:37:45.337068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.337052    2569 scope.go:117] "RemoveContainer" containerID="ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"
Jul 22 21:37:45.337286 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:37:45.337271    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d\": container with ID starting with ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d not found: ID does not exist" containerID="ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"
Jul 22 21:37:45.337331 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.337290    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d"} err="failed to get container status \"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d\": rpc error: code = NotFound desc = could not find container \"ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d\": container with ID starting with ee59ff7e703c03203ee525a19d3494038e9dad1fcacf38defe068799651cc33d not found: ID does not exist"
Jul 22 21:37:45.347418 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.347392    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:37:45.350795 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:45.350772    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-13623ccb-gw-openshift-default-86b4875547-5vj9l"]
Jul 22 21:37:47.151192 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:47.151154    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" path="/var/lib/kubelet/pods/8feb802b-7268-48f4-b31f-c0d286fb204c/volumes"
Jul 22 21:37:57.376513 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.376423    2569 generic.go:356] "Generic (PLEG): container finished" podID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerID="3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3" exitCode=0
Jul 22 21:37:57.376513 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.376499    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerDied","Data":"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"}
Jul 22 21:37:57.376957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.376865    2569 scope.go:117] "RemoveContainer" containerID="3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"
Jul 22 21:37:57.377862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.377831    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:57.377954 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.377940    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:57.378022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:57.377990    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:37:58.308292 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:58.308257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:58.383688 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:58.383643    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerStarted","Data":"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"}
Jul 22 21:37:58.917427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:58.917386    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:37:58.918400 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:58.918371    2569 patch_prober.go:28] interesting pod/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:37:58.918530 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:58.918433    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 22 21:37:59.917394 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:59.917356    2569 patch_prober.go:28] interesting pod/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:37:59.917802 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:37:59.917413    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 22 21:38:00.917764 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:00.917723    2569 patch_prober.go:28] interesting pod/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:38:00.918189 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:00.917779    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 22 21:38:01.917683 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:01.917645    2569 patch_prober.go:28] interesting pod/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:38:01.917876 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:01.917707    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 22 21:38:02.917529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:02.917494    2569 patch_prober.go:28] interesting pod/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 22 21:38:02.917702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:02.917549    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 22 21:38:03.921786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:03.921757    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:38:03.922213 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:03.922049    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:38:03.922742 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:03.922725    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:38:08.534101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.534064    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"]
Jul 22 21:38:08.534543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.534428    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:08.534543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.534444    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:08.534634 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.534549    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:08.534634 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.534561    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:08.537564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.537543    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:08.540194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.540170    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:38:08.540312 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.540209    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:38:08.544368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.544338    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"]
Jul 22 21:38:08.638083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.638039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67\" (UID: \"2ac96557-3131-443f-a1ba-bb66962db0f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:08.739311 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.739264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67\" (UID: \"2ac96557-3131-443f-a1ba-bb66962db0f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:08.739916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.739894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67\" (UID: \"2ac96557-3131-443f-a1ba-bb66962db0f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:08.851295 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.851206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:08.988243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:08.988208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"]
Jul 22 21:38:08.991978 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:38:08.991951    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac96557_3131_443f_a1ba_bb66962db0f0.slice/crio-9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12 WatchSource:0}: Error finding container 9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12: Status 404 returned error can't find the container with id 9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12
Jul 22 21:38:09.450534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:09.450414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67" event={"ID":"2ac96557-3131-443f-a1ba-bb66962db0f0","Type":"ContainerStarted","Data":"92533fc259d854a9834d816f5ad519f292f93743427b414c2608ff29f2491e6f"}
Jul 22 21:38:09.450534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:09.450523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67" event={"ID":"2ac96557-3131-443f-a1ba-bb66962db0f0","Type":"ContainerStarted","Data":"9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12"}
Jul 22 21:38:09.470314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:09.470260    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67" podStartSLOduration=1.470244462 podStartE2EDuration="1.470244462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:09.469332831 +0000 UTC m=+1950.806947707" watchObservedRunningTime="2026-07-22 21:38:09.470244462 +0000 UTC m=+1950.807859342"
Jul 22 21:38:10.457153 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:10.457091    2569 generic.go:356] "Generic (PLEG): container finished" podID="2ac96557-3131-443f-a1ba-bb66962db0f0" containerID="92533fc259d854a9834d816f5ad519f292f93743427b414c2608ff29f2491e6f" exitCode=0
Jul 22 21:38:10.457526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:10.457174    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67" event={"ID":"2ac96557-3131-443f-a1ba-bb66962db0f0","Type":"ContainerDied","Data":"92533fc259d854a9834d816f5ad519f292f93743427b414c2608ff29f2491e6f"}
Jul 22 21:38:11.594883 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:11.594854    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:11.667280 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:11.667247    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca\") pod \"2ac96557-3131-443f-a1ba-bb66962db0f0\" (UID: \"2ac96557-3131-443f-a1ba-bb66962db0f0\") "
Jul 22 21:38:11.667621 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:11.667597    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ac96557-3131-443f-a1ba-bb66962db0f0" (UID: "2ac96557-3131-443f-a1ba-bb66962db0f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:11.768670 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:11.768632    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac96557-3131-443f-a1ba-bb66962db0f0-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:12.467772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:12.467740    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"
Jul 22 21:38:12.467772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:12.467752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67" event={"ID":"2ac96557-3131-443f-a1ba-bb66962db0f0","Type":"ContainerDied","Data":"9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12"}
Jul 22 21:38:12.467991 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:12.467796    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9510b2b2c248cd7a4e1e742f0da5bf422933b3027fd7ef20c6bb6c453caa6b12"
Jul 22 21:38:19.117221 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:19.117183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:23.606273 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:23.606234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:23.607475 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:23.607438    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"]
Jul 22 21:38:23.609139 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:23.609109    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8712ba9a-t5p67"]
Jul 22 21:38:24.812766 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:24.812732    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:38:24.813247 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:24.812955    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy" containerID="cri-o://8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b" gracePeriod=30
Jul 22 21:38:24.842026 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:24.841994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:25.150314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.150237    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac96557-3131-443f-a1ba-bb66962db0f0" path="/var/lib/kubelet/pods/2ac96557-3131-443f-a1ba-bb66962db0f0/volumes"
Jul 22 21:38:25.155785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.155759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:25.333234 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.333197    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:25.688942 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.688905    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:38:25.689263 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.689249    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:25.689328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.689265    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8feb802b-7268-48f4-b31f-c0d286fb204c" containerName="istio-proxy"
Jul 22 21:38:25.689328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.689284    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac96557-3131-443f-a1ba-bb66962db0f0" containerName="revoke-keys"
Jul 22 21:38:25.689328 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.689291    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac96557-3131-443f-a1ba-bb66962db0f0" containerName="revoke-keys"
Jul 22 21:38:25.689433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.689348    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac96557-3131-443f-a1ba-bb66962db0f0" containerName="revoke-keys"
Jul 22 21:38:25.692449 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.692432    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.698178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.698151    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a2e03361-openshift-default-dockercfg-gp6fv\""
Jul 22 21:38:25.725219 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.725187    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:38:25.767385 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.767349    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:25.797265 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4s2s\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797265 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797626 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797626 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.797626 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.797624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.898595 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.898595 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4s2s\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.898821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899116 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.899035    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.899224    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.899273    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.899322    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.899517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.899491    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.901655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.901627    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.901762 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.901731    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.917442 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.917410    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4s2s\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:25.917987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:25.917961    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token\") pod \"e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") " pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:26.003381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.003344    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:26.163664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.163637    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:38:26.165997 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:38:26.165958    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8515d2d4_38fc_4180_ba87_cabf612811e2.slice/crio-e1848c5ab3e5d1f0e28f03951b30a88478389adeaa8b0f5a0462b468065b4176 WatchSource:0}: Error finding container e1848c5ab3e5d1f0e28f03951b30a88478389adeaa8b0f5a0462b468065b4176: Status 404 returned error can't find the container with id e1848c5ab3e5d1f0e28f03951b30a88478389adeaa8b0f5a0462b468065b4176
Jul 22 21:38:26.168317 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.168283    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:26.168404 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.168347    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:26.168404 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.168373    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:26.246314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.246277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:26.538519 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.538480    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerStarted","Data":"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"}
Jul 22 21:38:26.538732 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.538558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerStarted","Data":"e1848c5ab3e5d1f0e28f03951b30a88478389adeaa8b0f5a0462b468065b4176"}
Jul 22 21:38:26.571800 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:26.571733    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podStartSLOduration=1.5717098520000001 podStartE2EDuration="1.571709852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:26.564455272 +0000 UTC m=+1967.902070176" watchObservedRunningTime="2026-07-22 21:38:26.571709852 +0000 UTC m=+1967.909324732"
Jul 22 21:38:27.003886 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:27.003844    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:27.009737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:27.009705    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:27.543780 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:27.543751    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:27.544644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:27.544627    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:28.047636 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:28.047600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:28.169441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:28.169407    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:28.254530 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:28.254497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:28.857999 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:28.857969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:28.993845 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:28.993815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:30.068609 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.068587    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:38:30.243589 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243558    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxptp\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243597    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243646    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243665    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243713    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.243765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243731    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.244068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243780    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.244068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.243830    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs\") pod \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\" (UID: \"67783ea3-2b4d-4eb2-ba67-485677ad1a03\") "
Jul 22 21:38:30.244233 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.244197    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:30.244310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.244220    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:30.244516 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.244485    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:30.244809 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.244784    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:30.245335 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.245312    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data" (OuterVolumeSpecName: "istio-data") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:30.246064 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.246044    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token" (OuterVolumeSpecName: "istio-token") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:38:30.246206 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.246059    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp" (OuterVolumeSpecName: "kube-api-access-lxptp") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "kube-api-access-lxptp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:38:30.246527 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.246507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:38:30.246527 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.246511    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67783ea3-2b4d-4eb2-ba67-485677ad1a03" (UID: "67783ea3-2b4d-4eb2-ba67-485677ad1a03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:38:30.345107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345067    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345099    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxptp\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-kube-api-access-lxptp\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345109    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345117    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345146    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345154    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345162    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345171    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67783ea3-2b4d-4eb2-ba67-485677ad1a03-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.345389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.345179    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67783ea3-2b4d-4eb2-ba67-485677ad1a03-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:30.560327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.560226    2569 generic.go:356] "Generic (PLEG): container finished" podID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerID="8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b" exitCode=0
Jul 22 21:38:30.560327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.560283    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"
Jul 22 21:38:30.560553 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.560286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerDied","Data":"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"}
Jul 22 21:38:30.560553 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.560405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l" event={"ID":"67783ea3-2b4d-4eb2-ba67-485677ad1a03","Type":"ContainerDied","Data":"ea560c90e071c1f8d564eb6582fae3ed54c76cfa52af9332efc5951496a7ed90"}
Jul 22 21:38:30.560553 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.560426    2569 scope.go:117] "RemoveContainer" containerID="8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"
Jul 22 21:38:30.569633 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.569616    2569 scope.go:117] "RemoveContainer" containerID="3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"
Jul 22 21:38:30.577574 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.577551    2569 scope.go:117] "RemoveContainer" containerID="8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"
Jul 22 21:38:30.577844 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:38:30.577820    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b\": container with ID starting with 8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b not found: ID does not exist" containerID="8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"
Jul 22 21:38:30.577889 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.577853    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b"} err="failed to get container status \"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b\": rpc error: code = NotFound desc = could not find container \"8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b\": container with ID starting with 8a00054ce9bc7a98e5c6a314ec3ee1d7609ebb621a32f3b68baa29005754154b not found: ID does not exist"
Jul 22 21:38:30.577889 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.577870    2569 scope.go:117] "RemoveContainer" containerID="3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"
Jul 22 21:38:30.578104 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:38:30.578085    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3\": container with ID starting with 3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3 not found: ID does not exist" containerID="3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"
Jul 22 21:38:30.578169 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.578111    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3"} err="failed to get container status \"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3\": rpc error: code = NotFound desc = could not find container \"3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3\": container with ID starting with 3dc297b44f470eb1a012bb58710169d126b11071930455336bf1d2706938abf3 not found: ID does not exist"
Jul 22 21:38:30.582687 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.582657    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:38:30.586592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:30.586573    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8712ba9a-openshift-default-76cd4b86b5-bdd6l"]
Jul 22 21:38:31.150931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:31.150892    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" path="/var/lib/kubelet/pods/67783ea3-2b4d-4eb2-ba67-485677ad1a03/volumes"
Jul 22 21:38:42.812410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:42.811728    2569 patch_prober.go:28] interesting pod/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:39176->10.133.0.42:15021: read: connection reset by peer" start-of-body=
Jul 22 21:38:42.812410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:42.811804    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:39176->10.133.0.42:15021: read: connection reset by peer"
Jul 22 21:38:43.633513 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.633480    2569 generic.go:356] "Generic (PLEG): container finished" podID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerID="f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5" exitCode=0
Jul 22 21:38:43.633697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.633554    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerDied","Data":"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"}
Jul 22 21:38:43.633935 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.633920    2569 scope.go:117] "RemoveContainer" containerID="f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"
Jul 22 21:38:43.634919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.634879    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:43.635022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.634953    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:43.635022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:43.634986    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:38:44.646258 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:44.646217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerStarted","Data":"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"}
Jul 22 21:38:45.004233 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:45.004193    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:45.004446 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:45.004325    2569 patch_prober.go:28] interesting pod/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 21:38:45.004446 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:45.004371    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 21:38:46.003966 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:46.003923    2569 patch_prober.go:28] interesting pod/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 21:38:46.004644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:46.004608    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 21:38:47.004597 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:47.004550    2569 patch_prober.go:28] interesting pod/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 21:38:47.005099 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:47.004633    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 21:38:48.004604 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:48.004551    2569 patch_prober.go:28] interesting pod/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 21:38:48.005119 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:48.004660    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 21:38:49.007240 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:49.007211    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:49.007624 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:49.007555    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:49.008209 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:49.008190    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:38:52.799402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799366    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"]
Jul 22 21:38:52.799773 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799696    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:38:52.799773 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799707    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:38:52.799773 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799717    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:38:52.799773 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799723    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:38:52.799915 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.799785    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:38:52.802717 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.802700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:52.805548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.805524    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:38:52.805661 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.805524    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:38:52.809526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.809502    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"]
Jul 22 21:38:52.847893 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.847860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv\" (UID: \"299a9829-5618-4d79-9c5c-544e83219f36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:52.948907 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.948875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv\" (UID: \"299a9829-5618-4d79-9c5c-544e83219f36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:52.949534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:52.949507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv\" (UID: \"299a9829-5618-4d79-9c5c-544e83219f36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:53.114525 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:53.114419    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:53.244515 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:53.244469    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"]
Jul 22 21:38:53.246784 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:38:53.246758    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299a9829_5618_4d79_9c5c_544e83219f36.slice/crio-e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a WatchSource:0}: Error finding container e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a: Status 404 returned error can't find the container with id e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a
Jul 22 21:38:53.690915 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:53.690815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv" event={"ID":"299a9829-5618-4d79-9c5c-544e83219f36","Type":"ContainerStarted","Data":"ca33ceaf1e998b369e376111ec50f858bd16bf1ddf0d523482e96600d4647651"}
Jul 22 21:38:53.690915 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:53.690870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv" event={"ID":"299a9829-5618-4d79-9c5c-544e83219f36","Type":"ContainerStarted","Data":"e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a"}
Jul 22 21:38:53.705764 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:53.705598    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv" podStartSLOduration=1.7055790819999999 podStartE2EDuration="1.705579082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:53.705235503 +0000 UTC m=+1995.042850385" watchObservedRunningTime="2026-07-22 21:38:53.705579082 +0000 UTC m=+1995.043193961"
Jul 22 21:38:54.697466 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:54.697421    2569 generic.go:356] "Generic (PLEG): container finished" podID="299a9829-5618-4d79-9c5c-544e83219f36" containerID="ca33ceaf1e998b369e376111ec50f858bd16bf1ddf0d523482e96600d4647651" exitCode=0
Jul 22 21:38:54.697958 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:54.697494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv" event={"ID":"299a9829-5618-4d79-9c5c-544e83219f36","Type":"ContainerDied","Data":"ca33ceaf1e998b369e376111ec50f858bd16bf1ddf0d523482e96600d4647651"}
Jul 22 21:38:55.834847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:55.834824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:55.874914 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:55.874884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca\") pod \"299a9829-5618-4d79-9c5c-544e83219f36\" (UID: \"299a9829-5618-4d79-9c5c-544e83219f36\") "
Jul 22 21:38:55.875253 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:55.875228    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "299a9829-5618-4d79-9c5c-544e83219f36" (UID: "299a9829-5618-4d79-9c5c-544e83219f36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:55.975982 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:55.975893    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/299a9829-5618-4d79-9c5c-544e83219f36-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:38:56.690198 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:56.690162    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:38:56.708475 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:56.708440    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv" event={"ID":"299a9829-5618-4d79-9c5c-544e83219f36","Type":"ContainerDied","Data":"e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a"}
Jul 22 21:38:56.708628 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:56.708493    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f617ca71de78d1e6d018c484808e566db8f96fe6b8f4ea87e50ea723814f3a"
Jul 22 21:38:56.708628 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:56.708455    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"
Jul 22 21:38:56.793644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:38:56.793605    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:03.371684 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:03.371651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:03.472736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:03.472704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:03.630367 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:03.630280    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:07.896653 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:07.896608    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:07.897840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:07.897817    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"]
Jul 22 21:39:07.901277 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:07.901254    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a2e03361-q2fgv"]
Jul 22 21:39:08.073441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.073410    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:39:08.073659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.073620    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy" containerID="cri-o://c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366" gracePeriod=30
Jul 22 21:39:08.091840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.091810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:08.352664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.352618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:08.826849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.826798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:08.924303 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:08.924237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:09.026984 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:09.026953    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:09.150681 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:09.150598    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299a9829-5618-4d79-9c5c-544e83219f36" path="/var/lib/kubelet/pods/299a9829-5618-4d79-9c5c-544e83219f36/volumes"
Jul 22 21:39:10.520517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:10.520480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:13.341048 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.340966    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:39:13.427487 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4s2s\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427493    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427519    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427544    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427673    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427715    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427783    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.427840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427837    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.428039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427880    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs\") pod \"8515d2d4-38fc-4180-ba87-cabf612811e2\" (UID: \"8515d2d4-38fc-4180-ba87-cabf612811e2\") "
Jul 22 21:39:13.428039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.427903    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:39:13.428460 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.428197    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8515d2d4-38fc-4180-ba87-cabf612811e2-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.428460 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.428398    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:13.428460 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.428407    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:13.428635 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.428589    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:13.428677 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.428615    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:13.429905 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.429878    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:39:13.430024 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.429923    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s" (OuterVolumeSpecName: "kube-api-access-z4s2s") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "kube-api-access-z4s2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:13.430310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.430289    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:39:13.430521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.430503    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8515d2d4-38fc-4180-ba87-cabf612811e2" (UID: "8515d2d4-38fc-4180-ba87-cabf612811e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:13.529416 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529384    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529416 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529410    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529416 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529419    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4s2s\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-kube-api-access-z4s2s\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529428    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529437    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529444    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529451    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8515d2d4-38fc-4180-ba87-cabf612811e2-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.529598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.529459    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8515d2d4-38fc-4180-ba87-cabf612811e2-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:39:13.794669 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.794613    2569 generic.go:356] "Generic (PLEG): container finished" podID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerID="c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366" exitCode=0
Jul 22 21:39:13.794921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.794897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerDied","Data":"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"}
Jul 22 21:39:13.795040 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.795018    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"
Jul 22 21:39:13.795206 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.795187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc" event={"ID":"8515d2d4-38fc-4180-ba87-cabf612811e2","Type":"ContainerDied","Data":"e1848c5ab3e5d1f0e28f03951b30a88478389adeaa8b0f5a0462b468065b4176"}
Jul 22 21:39:13.795541 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.795291    2569 scope.go:117] "RemoveContainer" containerID="c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"
Jul 22 21:39:13.804728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.804717    2569 scope.go:117] "RemoveContainer" containerID="f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"
Jul 22 21:39:13.812033 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.812013    2569 scope.go:117] "RemoveContainer" containerID="c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"
Jul 22 21:39:13.812274 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:39:13.812258    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366\": container with ID starting with c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366 not found: ID does not exist" containerID="c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"
Jul 22 21:39:13.812341 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.812279    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366"} err="failed to get container status \"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366\": rpc error: code = NotFound desc = could not find container \"c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366\": container with ID starting with c7b229a1e564113fb079410097556e55c07146131f5f854b378e806bd7dbf366 not found: ID does not exist"
Jul 22 21:39:13.812341 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.812294    2569 scope.go:117] "RemoveContainer" containerID="f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"
Jul 22 21:39:13.812506 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:39:13.812490    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5\": container with ID starting with f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5 not found: ID does not exist" containerID="f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"
Jul 22 21:39:13.812543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.812510    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5"} err="failed to get container status \"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5\": rpc error: code = NotFound desc = could not find container \"f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5\": container with ID starting with f06ee8e200d7c63ca7592d44041bb1d8407e046e685c22e46022e970fa2fefb5 not found: ID does not exist"
Jul 22 21:39:13.817334 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.817311    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:39:13.821271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:13.821247    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a2e03361-openshift-default-cf45f798c-mm4dc"]
Jul 22 21:39:15.150774 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:15.150740    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" path="/var/lib/kubelet/pods/8515d2d4-38fc-4180-ba87-cabf612811e2/volumes"
Jul 22 21:39:17.515120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:17.515089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:17.624038 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:17.623986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:17.737236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:17.737166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:17.841784 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:17.841691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:18.233386 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:18.233356    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:44.201121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:44.201086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:50.103538 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:50.103502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:50.272885 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:50.272858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:39:50.370737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:39:50.370657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:06.183891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:06.183809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:12.215494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:12.215461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:12.328828 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:12.328797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:12.418252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:12.418213    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:16.945558 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:16.945525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:23.011422 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:23.011389    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:23.880347 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:23.880318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:31.028437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:31.028402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:31.163753 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:31.163722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:31.254861 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:31.254830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:31.361142 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:31.361055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:32.243905 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:32.243869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:32.549501 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:32.549413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:34.216507 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:34.216475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:39.233290 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:39.233256    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:40:39.237104 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:39.237080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:40:40.393855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:40.393817    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:40.493884 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:40.493850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:41.098738 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:41.098705    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:48.087216 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.087181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:48.185883 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.185852    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:48.355703 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.355631    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:48.721495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721419    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:40:48.721770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721758    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721771    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721780    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721785    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721802    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299a9829-5618-4d79-9c5c-544e83219f36" containerName="revoke-keys"
Jul 22 21:40:48.721813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721808    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="299a9829-5618-4d79-9c5c-544e83219f36" containerName="revoke-keys"
Jul 22 21:40:48.721964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721853    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67783ea3-2b4d-4eb2-ba67-485677ad1a03" containerName="istio-proxy"
Jul 22 21:40:48.721964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721860    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721867    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8515d2d4-38fc-4180-ba87-cabf612811e2" containerName="istio-proxy"
Jul 22 21:40:48.721964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.721874    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="299a9829-5618-4d79-9c5c-544e83219f36" containerName="revoke-keys"
Jul 22 21:40:48.724696 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.724660    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.727571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.727552    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-797b14ce-openshift-default-dockercfg-gd7ln\""
Jul 22 21:40:48.759246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.759210    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:40:48.802000 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.801974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:48.843008 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.842979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843172 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843172 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843172 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khgn\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843251    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.843526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.843402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khgn\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944830 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944670    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944830 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.944977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.945042 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.944958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.945327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.945308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.946814 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.946787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.947102 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.947084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.960074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.960051    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khgn\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:48.960814 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:48.960796    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token\") pod \"e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") " pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:49.035926 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.035899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:49.184751 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.184717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:49.195293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.195270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:40:49.196792 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:40:49.196767    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a28ca2_e5e7_4eea_8543_ce8d05efa793.slice/crio-ddbcb6c929167a50c94a39cd02ad1926a2b93b9ea8b22e773d52803224032fe1 WatchSource:0}: Error finding container ddbcb6c929167a50c94a39cd02ad1926a2b93b9ea8b22e773d52803224032fe1: Status 404 returned error can't find the container with id ddbcb6c929167a50c94a39cd02ad1926a2b93b9ea8b22e773d52803224032fe1
Jul 22 21:40:49.198659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.198629    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:40:49.198730 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.198692    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:40:49.198730 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.198719    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:40:49.228992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:49.228965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerStarted","Data":"ddbcb6c929167a50c94a39cd02ad1926a2b93b9ea8b22e773d52803224032fe1"}
Jul 22 21:40:50.234702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:50.234662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerStarted","Data":"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"}
Jul 22 21:40:50.272480 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:50.272430    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podStartSLOduration=2.272410099 podStartE2EDuration="2.272410099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:40:50.270366167 +0000 UTC m=+2111.607981045" watchObservedRunningTime="2026-07-22 21:40:50.272410099 +0000 UTC m=+2111.610024978"
Jul 22 21:40:51.036942 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:51.036905    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:51.041703 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:51.041678    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:51.239081 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:51.239053    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:51.240012 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:51.239993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:40:52.468636 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:52.468600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:52.678788 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:52.678753    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:52.881242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:52.881209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:53.661611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:53.661576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:53.860197 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:53.860164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:56.932653 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:56.932615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:57.629004 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:57.628969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:57.841831 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:57.841796    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:40:58.113249 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:40:58.113214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:03.921745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:03.921655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:03.983726 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:03.983678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:04.300989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.300961    2569 generic.go:356] "Generic (PLEG): container finished" podID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerID="b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983" exitCode=0
Jul 22 21:41:04.301162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.301012    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerDied","Data":"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"}
Jul 22 21:41:04.301407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.301391    2569 scope.go:117] "RemoveContainer" containerID="b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"
Jul 22 21:41:04.302392 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.302360    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:04.302463 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.302449    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:04.302511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.302497    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:04.318003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.317981    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"]
Jul 22 21:41:04.321027 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.321010    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:04.324050 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.324030    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:41:04.324210 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.324092    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:41:04.333584 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.333542    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"]
Jul 22 21:41:04.369467 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.369439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr\" (UID: \"b3426a49-3e50-47b1-8edd-cf57bb98b495\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:04.469921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.469886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr\" (UID: \"b3426a49-3e50-47b1-8edd-cf57bb98b495\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:04.470498 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.470481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr\" (UID: \"b3426a49-3e50-47b1-8edd-cf57bb98b495\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:04.658789 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.658708    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:04.819543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:04.819512    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"]
Jul 22 21:41:04.820908 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:41:04.820884    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3426a49_3e50_47b1_8edd_cf57bb98b495.slice/crio-659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52 WatchSource:0}: Error finding container 659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52: Status 404 returned error can't find the container with id 659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52
Jul 22 21:41:05.311213 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:05.311092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerStarted","Data":"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"}
Jul 22 21:41:05.313825 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:05.313788    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr" event={"ID":"b3426a49-3e50-47b1-8edd-cf57bb98b495","Type":"ContainerStarted","Data":"86e363ca7fa3bf35c7daf32d52669c9271279af1e54c7f8780ff6c2f5967d3cd"}
Jul 22 21:41:05.313951 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:05.313854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr" event={"ID":"b3426a49-3e50-47b1-8edd-cf57bb98b495","Type":"ContainerStarted","Data":"659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52"}
Jul 22 21:41:05.386094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:05.386029    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr" podStartSLOduration=1.3860094410000001 podStartE2EDuration="1.386009441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:41:05.383616888 +0000 UTC m=+2126.721231767" watchObservedRunningTime="2026-07-22 21:41:05.386009441 +0000 UTC m=+2126.723624322"
Jul 22 21:41:06.036931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.036900    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:06.038056 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.037997    2569 patch_prober.go:28] interesting pod/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 21:41:06.038170 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.038052    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 21:41:06.240084 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.240048    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:06.320361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.320273    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3426a49-3e50-47b1-8edd-cf57bb98b495" containerID="86e363ca7fa3bf35c7daf32d52669c9271279af1e54c7f8780ff6c2f5967d3cd" exitCode=0
Jul 22 21:41:06.320739 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:06.320359    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr" event={"ID":"b3426a49-3e50-47b1-8edd-cf57bb98b495","Type":"ContainerDied","Data":"86e363ca7fa3bf35c7daf32d52669c9271279af1e54c7f8780ff6c2f5967d3cd"}
Jul 22 21:41:07.036611 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.036573    2569 patch_prober.go:28] interesting pod/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 21:41:07.036789 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.036627    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 21:41:07.468629 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.468605    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:07.599154 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.599043    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca\") pod \"b3426a49-3e50-47b1-8edd-cf57bb98b495\" (UID: \"b3426a49-3e50-47b1-8edd-cf57bb98b495\") "
Jul 22 21:41:07.599608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.599575    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3426a49-3e50-47b1-8edd-cf57bb98b495" (UID: "b3426a49-3e50-47b1-8edd-cf57bb98b495"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:41:07.700088 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:07.700058    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3426a49-3e50-47b1-8edd-cf57bb98b495-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:08.037246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:08.037204    2569 patch_prober.go:28] interesting pod/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 21:41:08.037413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:08.037265    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 21:41:08.331887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:08.331807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr" event={"ID":"b3426a49-3e50-47b1-8edd-cf57bb98b495","Type":"ContainerDied","Data":"659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52"}
Jul 22 21:41:08.331887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:08.331832    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"
Jul 22 21:41:08.331887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:08.331859    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="659f9e8febd2f8599fa66dfed7df77eef9f7a12583a80bd1823a4b373ad76c52"
Jul 22 21:41:09.036268 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:09.036235    2569 patch_prober.go:28] interesting pod/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 22 21:41:09.036649 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:09.036285    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 22 21:41:10.040329 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:10.040298    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:10.041406 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:10.041385    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:14.699405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:14.699372    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:19.401840 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:19.401805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:19.410352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:19.410318    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"]
Jul 22 21:41:19.416598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:19.416577    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-797b14ce-qmxsr"]
Jul 22 21:41:19.822327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:19.822290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:21.150662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:21.150632    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3426a49-3e50-47b1-8edd-cf57bb98b495" path="/var/lib/kubelet/pods/b3426a49-3e50-47b1-8edd-cf57bb98b495/volumes"
Jul 22 21:41:23.369034 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:23.368996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:25.903218 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:25.903186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.000661 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.000626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.153795 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.153711    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:41:26.153959 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.153931    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy" containerID="cri-o://ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf" gracePeriod=30
Jul 22 21:41:26.182084 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.182055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.414516 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.414417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.563162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.563109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.707435 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.707348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:26.822084 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:26.822051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:31.401088 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.401065    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:31.445529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.445458    2569 generic.go:356] "Generic (PLEG): container finished" podID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerID="ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf" exitCode=0
Jul 22 21:41:31.445529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.445502    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"
Jul 22 21:41:31.445529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.445505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerDied","Data":"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"}
Jul 22 21:41:31.445783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.445548    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4" event={"ID":"38a28ca2-e5e7-4eea-8543-ce8d05efa793","Type":"ContainerDied","Data":"ddbcb6c929167a50c94a39cd02ad1926a2b93b9ea8b22e773d52803224032fe1"}
Jul 22 21:41:31.445783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.445570    2569 scope.go:117] "RemoveContainer" containerID="ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"
Jul 22 21:41:31.455500 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.455485    2569 scope.go:117] "RemoveContainer" containerID="b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"
Jul 22 21:41:31.462949 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.462932    2569 scope.go:117] "RemoveContainer" containerID="ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"
Jul 22 21:41:31.463237 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:41:31.463218    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf\": container with ID starting with ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf not found: ID does not exist" containerID="ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"
Jul 22 21:41:31.463298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.463248    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf"} err="failed to get container status \"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf\": rpc error: code = NotFound desc = could not find container \"ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf\": container with ID starting with ebba1717a2e15b7dfed2536c7c63d434d7a129d9c90843636fef49a1036bf6bf not found: ID does not exist"
Jul 22 21:41:31.463298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.463265    2569 scope.go:117] "RemoveContainer" containerID="b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"
Jul 22 21:41:31.463495 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:41:31.463476    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983\": container with ID starting with b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983 not found: ID does not exist" containerID="b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"
Jul 22 21:41:31.463545 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.463506    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983"} err="failed to get container status \"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983\": rpc error: code = NotFound desc = could not find container \"b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983\": container with ID starting with b6d586e661d373a879f8a58d2084d3759d78641836491e14a4d5b8d9eb8fe983 not found: ID does not exist"
Jul 22 21:41:31.490474 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490453    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490479    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490532    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8khgn\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490701 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490566    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490701 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490608    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490701 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490661    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490701 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490897 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490737    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert\") pod \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\" (UID: \"38a28ca2-e5e7-4eea-8543-ce8d05efa793\") "
Jul 22 21:41:31.490951 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490892    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:41:31.491018 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.490995    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.491071 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.491022    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:41:31.491279 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.491184    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:41:31.491279 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.491227    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:41:31.491506 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.491315    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data" (OuterVolumeSpecName: "istio-data") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:41:31.492723 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.492699    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn" (OuterVolumeSpecName: "kube-api-access-8khgn") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "kube-api-access-8khgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:41:31.492817 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.492779    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:41:31.493059 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.493044    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:41:31.493157 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.493117    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token" (OuterVolumeSpecName: "istio-token") pod "38a28ca2-e5e7-4eea-8543-ce8d05efa793" (UID: "38a28ca2-e5e7-4eea-8543-ce8d05efa793"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:41:31.591652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591629    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591650    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591658    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591667    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8khgn\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-kube-api-access-8khgn\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591677    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591685    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591693    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38a28ca2-e5e7-4eea-8543-ce8d05efa793-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.591782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.591700    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38a28ca2-e5e7-4eea-8543-ce8d05efa793-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:41:31.784929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.784907    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:41:31.796454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:31.796434    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-797b14ce-openshift-default-65d97d49f9-hpjm4"]
Jul 22 21:41:33.150410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:33.150381    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" path="/var/lib/kubelet/pods/38a28ca2-e5e7-4eea-8543-ce8d05efa793/volumes"
Jul 22 21:41:34.048057 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:34.048028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:34.159297 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:34.159256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:34.302709 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:34.302610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:34.441862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:34.441839    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:40.670495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:40.670463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:40.793029 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:40.792999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:47.757362 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:47.757328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:48.113118 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113041    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:41:48.113388 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113376    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:41:48.113437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113389    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:41:48.113437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113409    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3426a49-3e50-47b1-8edd-cf57bb98b495" containerName="revoke-keys"
Jul 22 21:41:48.113437 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113414    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3426a49-3e50-47b1-8edd-cf57bb98b495" containerName="revoke-keys"
Jul 22 21:41:48.113548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113465    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:41:48.113548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113474    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:41:48.113548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.113482    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3426a49-3e50-47b1-8edd-cf57bb98b495" containerName="revoke-keys"
Jul 22 21:41:48.116406 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.116384    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.122915 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.122886    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b765b624-openshift-default-dockercfg-dz2n7\""
Jul 22 21:41:48.131311 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.131281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:48.154350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.154332    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:41:48.213069 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213228 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bszf\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213406 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213505 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213628 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213609    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213661 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.213693 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.213676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314204 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bszf\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314316 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314345    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314615 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314615 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314615 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314484    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314769 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314769 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314734    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314844 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314803    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.314898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.314878    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.315293 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.315211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.316632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.316606    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.316835 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.316818    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.346534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.346509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.358808 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.358783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bszf\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf\") pod \"e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") " pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.425643 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.425586    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:48.528772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.528723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:48.572684 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.572662    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:41:48.575156 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:41:48.575120    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d81172_ad9d_411d_ac90_6625a8de48e5.slice/crio-ebae1f7cc108bd2aa206a8cfc5fbebce5c62a5aa19dfcb590cc0c3ce9675960a WatchSource:0}: Error finding container ebae1f7cc108bd2aa206a8cfc5fbebce5c62a5aa19dfcb590cc0c3ce9675960a: Status 404 returned error can't find the container with id ebae1f7cc108bd2aa206a8cfc5fbebce5c62a5aa19dfcb590cc0c3ce9675960a
Jul 22 21:41:48.577029 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.576998    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:48.577119 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.577079    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:48.577203 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:48.577123    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:41:49.536936 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:49.536905    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerStarted","Data":"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"}
Jul 22 21:41:49.537346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:49.536956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerStarted","Data":"ebae1f7cc108bd2aa206a8cfc5fbebce5c62a5aa19dfcb590cc0c3ce9675960a"}
Jul 22 21:41:49.581140 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:49.581093    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podStartSLOduration=1.581079594 podStartE2EDuration="1.581079594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:41:49.580189276 +0000 UTC m=+2170.917804152" watchObservedRunningTime="2026-07-22 21:41:49.581079594 +0000 UTC m=+2170.918694470"
Jul 22 21:41:50.426177 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:50.426115    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:50.431092 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:50.431065    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:50.541368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:50.541343    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:50.542051 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:50.542035    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:41:51.742573 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:51.742539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:52.019103 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:52.019028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:52.159243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:52.159209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:52.412287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:52.412211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:53.018728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:53.018695    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:53.143771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:53.143730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:41:56.166658 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:41:56.166626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:06.000109 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:05.999955    2569 patch_prober.go:28] interesting pod/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:46328->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 22 21:42:06.000109 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.000035    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:46328->10.133.0.46:15021: read: connection reset by peer"
Jul 22 21:42:06.110755 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.110722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:06.627258 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.627227    2569 generic.go:356] "Generic (PLEG): container finished" podID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerID="b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a" exitCode=0
Jul 22 21:42:06.627412 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.627269    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerDied","Data":"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"}
Jul 22 21:42:06.627612 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.627600    2569 scope.go:117] "RemoveContainer" containerID="b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"
Jul 22 21:42:06.628550 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.628519    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:42:06.628623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.628606    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:42:06.628672 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:06.628658    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:42:07.633407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:07.633375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerStarted","Data":"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"}
Jul 22 21:42:08.426003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:08.425971    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:42:08.426306 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:08.426283    2569 patch_prober.go:28] interesting pod/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:42:08.426413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:08.426336    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 21:42:09.426287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:09.426250    2569 patch_prober.go:28] interesting pod/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:42:09.426669 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:09.426304    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 21:42:10.426797 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:10.426759    2569 patch_prober.go:28] interesting pod/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 21:42:10.427299 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:10.426824    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 21:42:11.430327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:11.430296    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:42:11.430718 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:11.430563    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:42:11.431333 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:11.431311    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:42:29.613452 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.613421    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"]
Jul 22 21:42:29.613889 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.613783    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:42:29.613889 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.613796    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a28ca2-e5e7-4eea-8543-ce8d05efa793" containerName="istio-proxy"
Jul 22 21:42:29.616898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.616879    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:29.619190 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.619172    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:42:29.619294 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.619223    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:42:29.626580 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.626546    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"]
Jul 22 21:42:29.646752 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.646730    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b765b624-76v6g\" (UID: \"08db9a90-c75a-4789-9e16-061e1eb8b96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:29.747291 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.747257    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b765b624-76v6g\" (UID: \"08db9a90-c75a-4789-9e16-061e1eb8b96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:29.747781 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.747765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b765b624-76v6g\" (UID: \"08db9a90-c75a-4789-9e16-061e1eb8b96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:29.934374 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:29.934318    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:30.070301 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:30.070278    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"]
Jul 22 21:42:30.071753 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:42:30.071729    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08db9a90_c75a_4789_9e16_061e1eb8b96b.slice/crio-ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041 WatchSource:0}: Error finding container ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041: Status 404 returned error can't find the container with id ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041
Jul 22 21:42:30.742321 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:30.742288    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g" event={"ID":"08db9a90-c75a-4789-9e16-061e1eb8b96b","Type":"ContainerStarted","Data":"27806f30ba1629e449bcfd99b50dcd8cece4010fd5b2e8b98f9275259ac83b8b"}
Jul 22 21:42:30.742686 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:30.742342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g" event={"ID":"08db9a90-c75a-4789-9e16-061e1eb8b96b","Type":"ContainerStarted","Data":"ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041"}
Jul 22 21:42:30.770423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:30.770384    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g" podStartSLOduration=1.770368082 podStartE2EDuration="1.770368082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:42:30.770241761 +0000 UTC m=+2212.107856638" watchObservedRunningTime="2026-07-22 21:42:30.770368082 +0000 UTC m=+2212.107982957"
Jul 22 21:42:31.748725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:31.748691    2569 generic.go:356] "Generic (PLEG): container finished" podID="08db9a90-c75a-4789-9e16-061e1eb8b96b" containerID="27806f30ba1629e449bcfd99b50dcd8cece4010fd5b2e8b98f9275259ac83b8b" exitCode=0
Jul 22 21:42:31.748725 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:31.748729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g" event={"ID":"08db9a90-c75a-4789-9e16-061e1eb8b96b","Type":"ContainerDied","Data":"27806f30ba1629e449bcfd99b50dcd8cece4010fd5b2e8b98f9275259ac83b8b"}
Jul 22 21:42:32.878237 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:32.878214    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:32.971365 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:32.971341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca\") pod \"08db9a90-c75a-4789-9e16-061e1eb8b96b\" (UID: \"08db9a90-c75a-4789-9e16-061e1eb8b96b\") "
Jul 22 21:42:32.971654 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:32.971634    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08db9a90-c75a-4789-9e16-061e1eb8b96b" (UID: "08db9a90-c75a-4789-9e16-061e1eb8b96b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:42:33.072003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:33.071949    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08db9a90-c75a-4789-9e16-061e1eb8b96b-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:42:33.759314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:33.759287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g" event={"ID":"08db9a90-c75a-4789-9e16-061e1eb8b96b","Type":"ContainerDied","Data":"ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041"}
Jul 22 21:42:33.759314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:33.759303    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"
Jul 22 21:42:33.759484 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:33.759331    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed272daff5d0ef0b3b9b7f9585007c6096ed5a8d4a00bf73dd2aa51219c58041"
Jul 22 21:42:34.286499 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:34.286470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:39.300568 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:39.300534    2569 scope.go:117] "RemoveContainer" containerID="79a3f4ec818547dad96c7872eb9486bd8d475da7f23c5ad0d7b4ef19c9d62fea"
Jul 22 21:42:45.099235 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:45.099201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:49.696332 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:49.696304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:49.707977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:49.707950    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"]
Jul 22 21:42:49.710991 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:49.710968    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b765b624-76v6g"]
Jul 22 21:42:51.150007 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:51.149976    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08db9a90-c75a-4789-9e16-061e1eb8b96b" path="/var/lib/kubelet/pods/08db9a90-c75a-4789-9e16-061e1eb8b96b/volumes"
Jul 22 21:42:51.935077 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:51.935047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:42:57.018917 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:42:57.018881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:11.691862 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:11.691783    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:11.791656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:11.791627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:12.885564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:12.885528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:34.325001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:34.324963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:34.575902 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:34.575835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:39.318882 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:39.318848    2569 scope.go:117] "RemoveContainer" containerID="f51f9ecb1dbf8e2586059e758487f28c50b873f06e1a77db66a5f8dae805db4a"
Jul 22 21:43:40.889000 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:40.888971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:40.983875 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:40.983845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:41.233280 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.233247    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:43:41.233493 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.233471    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" containerID="cri-o://cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146" gracePeriod=30
Jul 22 21:43:41.309673 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.309644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:41.432952 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.432915    2569 patch_prober.go:28] interesting pod/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:43:41.433099 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.432980    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:43:41.492905 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:41.492834    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:42.763515 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:42.763481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:42.966269 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:42.966236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:43.729674 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:43.729643    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:43.877817 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:43.877782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:45.367348 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:45.367302    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:46.487443 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.487418    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:43:46.600871 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600808    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.600987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600875    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.600987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600903    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.600987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600920    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.600987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600938    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bszf\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.600987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.600964    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.601256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601014    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.601256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601044    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.601256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601067    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket\") pod \"96d81172-ad9d-411d-ac90-6625a8de48e5\" (UID: \"96d81172-ad9d-411d-ac90-6625a8de48e5\") "
Jul 22 21:43:46.601256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601200    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:43:46.601464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601252    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:43:46.601464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601385    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:43:46.601464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601394    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:43:46.601464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601404    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.601464 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601463    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.601999 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.601960    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:43:46.603360 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.603336    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:43:46.603490 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.603469    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:43:46.603490 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.603475    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:43:46.603637 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.603619    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf" (OuterVolumeSpecName: "kube-api-access-5bszf") pod "96d81172-ad9d-411d-ac90-6625a8de48e5" (UID: "96d81172-ad9d-411d-ac90-6625a8de48e5"). InnerVolumeSpecName "kube-api-access-5bszf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:43:46.702433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702403    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702431    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702440    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96d81172-ad9d-411d-ac90-6625a8de48e5-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702449    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702456    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96d81172-ad9d-411d-ac90-6625a8de48e5-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702464    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bszf\" (UniqueName: \"kubernetes.io/projected/96d81172-ad9d-411d-ac90-6625a8de48e5-kube-api-access-5bszf\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:46.702596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:46.702472    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96d81172-ad9d-411d-ac90-6625a8de48e5-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:43:47.113743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.113712    2569 generic.go:356] "Generic (PLEG): container finished" podID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerID="cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146" exitCode=0
Jul 22 21:43:47.113921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.113755    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"
Jul 22 21:43:47.113921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.113774    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerDied","Data":"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"}
Jul 22 21:43:47.113921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.113827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz" event={"ID":"96d81172-ad9d-411d-ac90-6625a8de48e5","Type":"ContainerDied","Data":"ebae1f7cc108bd2aa206a8cfc5fbebce5c62a5aa19dfcb590cc0c3ce9675960a"}
Jul 22 21:43:47.113921 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.113856    2569 scope.go:117] "RemoveContainer" containerID="cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"
Jul 22 21:43:47.122874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.122856    2569 scope.go:117] "RemoveContainer" containerID="b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"
Jul 22 21:43:47.130314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.130301    2569 scope.go:117] "RemoveContainer" containerID="cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"
Jul 22 21:43:47.130567 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:43:47.130548    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146\": container with ID starting with cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146 not found: ID does not exist" containerID="cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"
Jul 22 21:43:47.130632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.130575    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146"} err="failed to get container status \"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146\": rpc error: code = NotFound desc = could not find container \"cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146\": container with ID starting with cb95f5c90ee2dc39939acb2dfde81bf46afc439a55aed6862af05f44b8655146 not found: ID does not exist"
Jul 22 21:43:47.130632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.130593    2569 scope.go:117] "RemoveContainer" containerID="b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"
Jul 22 21:43:47.130824 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:43:47.130809    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a\": container with ID starting with b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a not found: ID does not exist" containerID="b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"
Jul 22 21:43:47.130865 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.130831    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a"} err="failed to get container status \"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a\": rpc error: code = NotFound desc = could not find container \"b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a\": container with ID starting with b87791e0f31619afa7fb05b3b81550e6b901aaf1b50a960be1d41420e868f26a not found: ID does not exist"
Jul 22 21:43:47.153858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.153837    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:43:47.179938 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:47.179917    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b765b624-openshift-default-7bc44d5f87-snwgz"]
Jul 22 21:43:49.150593 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:49.150558    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" path="/var/lib/kubelet/pods/96d81172-ad9d-411d-ac90-6625a8de48e5/volumes"
Jul 22 21:43:51.420562 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:51.420518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:51.669017 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:51.668982    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:52.171766 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:52.171737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:57.643166 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:57.643118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:57.991976 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:57.991945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:59.409120 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:59.409082    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:59.514513 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:59.514479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:59.628550 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:59.628525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:43:59.733314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:43:59.733289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:10.222315 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:10.222286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:10.565515 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:10.565475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:31.612946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:31.612862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:37.925253 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:37.925225    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:38.001659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.001633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:38.251533 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.251505    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:38.678359 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678286    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:44:38.678622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678608    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:38.678667 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678624    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:38.678667 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678648    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08db9a90-c75a-4789-9e16-061e1eb8b96b" containerName="revoke-keys"
Jul 22 21:44:38.678667 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678654    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="08db9a90-c75a-4789-9e16-061e1eb8b96b" containerName="revoke-keys"
Jul 22 21:44:38.678770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678702    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:38.678770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678710    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:38.678770 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.678715    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="08db9a90-c75a-4789-9e16-061e1eb8b96b" containerName="revoke-keys"
Jul 22 21:44:38.681609 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.681594    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.685304 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.685281    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3fc251-openshift-default-dockercfg-jchlb\""
Jul 22 21:44:38.713880 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.713850    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:44:38.780875 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.780845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781014 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.780890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781014 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.780954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781014 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.780990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781014 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.781008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.781024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfcm\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.781051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.781101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.781179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.781141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.788609 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.788587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:38.882197 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882197 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfcm\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882425    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882610    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.882879 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882798    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.883034 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.882981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.883034 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.883029    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.884652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.884619    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.885029 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.885011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.893045 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.892999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:38.893969 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.893947    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfcm\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.895042 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.895023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token\") pod \"e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") " pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:38.991454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:38.991432    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:39.126028 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.126007    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:44:39.127559 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:44:39.127535    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cbfabc_c7b1_4d3a_9fa3_8c4a3c4c8e1a.slice/crio-782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b WatchSource:0}: Error finding container 782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b: Status 404 returned error can't find the container with id 782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b
Jul 22 21:44:39.129396 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.129365    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:39.129470 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.129429    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:39.129470 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.129454    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:39.338055 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.337838    2569 scope.go:117] "RemoveContainer" containerID="92533fc259d854a9834d816f5ad519f292f93743427b414c2608ff29f2491e6f"
Jul 22 21:44:39.357420 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.357183    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerStarted","Data":"2b3c15057ca5c317465231fffc0071ce1fec465747fe05754db3516a7bd9f0b1"}
Jul 22 21:44:39.357420 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.357238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerStarted","Data":"782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b"}
Jul 22 21:44:39.380394 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.380344    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podStartSLOduration=1.380328771 podStartE2EDuration="1.380328771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:44:39.379226271 +0000 UTC m=+2340.716841147" watchObservedRunningTime="2026-07-22 21:44:39.380328771 +0000 UTC m=+2340.717943647"
Jul 22 21:44:39.991706 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:39.991673    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:40.997517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:40.997484    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:41.279829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.279720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:41.366685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.366660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:41.367702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.367683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:41.370753 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.370729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:41.657968 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.657890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:41.937726 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:41.937653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:42.369895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:42.369861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:42.474375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:42.474348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:45.839353 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:45.839318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:46.193350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.193253    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:46.469342 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.469272    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:44:46.469594 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.469582    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:46.469638 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.469596    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d81172-ad9d-411d-ac90-6625a8de48e5" containerName="istio-proxy"
Jul 22 21:44:46.472807 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.472783    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.475963 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.475942    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4a3a7e-openshift-default-dockercfg-dsfd4\""
Jul 22 21:44:46.496094 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.496070    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:44:46.502368 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.502349    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:46.541268 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541245    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541370 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541275    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541370 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541292    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541370 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541352    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541505 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541505 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmd8q\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541505 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541540    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.541623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.541565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643037 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmd8q\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643521    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643562    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643870    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.643985 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.643969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.645526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.645504    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.645633 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.645539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.663762 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.663741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.663864 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.663742    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmd8q\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q\") pod \"e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") " pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.782586 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.782561    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:46.918796 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.918762    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:44:46.921671 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:44:46.921644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8c9188_cd2d_460d_a6f2_f91c047facd8.slice/crio-9cade78df940c3f3c18d5896cb8c0af582b1378ea81c605f83a658146cb48e86 WatchSource:0}: Error finding container 9cade78df940c3f3c18d5896cb8c0af582b1378ea81c605f83a658146cb48e86: Status 404 returned error can't find the container with id 9cade78df940c3f3c18d5896cb8c0af582b1378ea81c605f83a658146cb48e86
Jul 22 21:44:46.923772 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.923740    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:46.923847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.923807    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:46.923847 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.923832    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:46.934911 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:46.934888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:47.404150 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:47.402965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerStarted","Data":"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"}
Jul 22 21:44:47.404150 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:47.403056    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerStarted","Data":"9cade78df940c3f3c18d5896cb8c0af582b1378ea81c605f83a658146cb48e86"}
Jul 22 21:44:47.428718 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:47.428661    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podStartSLOduration=1.4286438590000001 podStartE2EDuration="1.428643859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:44:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:44:47.42688415 +0000 UTC m=+2348.764499027" watchObservedRunningTime="2026-07-22 21:44:47.428643859 +0000 UTC m=+2348.766258737"
Jul 22 21:44:47.783217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:47.783186    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:47.794644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:47.794616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:48.411069 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:48.410859    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:48.413090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:48.413067    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:44:49.357338 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:49.357304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:49.455346 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:49.455312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:49.626521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:49.626438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:49.821712 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:49.821682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:50.200604 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:50.200570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:50.304199 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:50.304163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:53.832752 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:53.832720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:44:54.440443 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.440414    2569 generic.go:356] "Generic (PLEG): container finished" podID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerID="2b3c15057ca5c317465231fffc0071ce1fec465747fe05754db3516a7bd9f0b1" exitCode=0
Jul 22 21:44:54.440596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.440487    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerDied","Data":"2b3c15057ca5c317465231fffc0071ce1fec465747fe05754db3516a7bd9f0b1"}
Jul 22 21:44:54.440818 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.440804    2569 scope.go:117] "RemoveContainer" containerID="2b3c15057ca5c317465231fffc0071ce1fec465747fe05754db3516a7bd9f0b1"
Jul 22 21:44:54.441733 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.441705    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:54.441807 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.441789    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:54.441850 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:54.441839    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:44:55.447423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:55.447385    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerStarted","Data":"5df9b1dc7f126a4369aed5b95234a19e5133a711061cf607e967e26e8ee091cc"}
Jul 22 21:44:55.993409 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:55.993380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:55.993785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:55.993760    2569 patch_prober.go:28] interesting pod/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 21:44:55.993955 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:55.993932    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 21:44:56.367653 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:56.367566    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:44:56.992096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:56.992053    2569 patch_prober.go:28] interesting pod/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 21:44:56.992584 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:56.992120    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 21:44:57.992708 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:57.992658    2569 patch_prober.go:28] interesting pod/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 21:44:57.993302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:57.993256    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 21:44:58.992356 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:58.992313    2569 patch_prober.go:28] interesting pod/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 21:44:58.992554 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:44:58.992378    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 21:45:00.001069 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.001018    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:45:00.002499 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.002472    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:45:00.144311 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.144281    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"]
Jul 22 21:45:00.151205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.149806    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"]
Jul 22 21:45:00.152243 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.152219    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"
Jul 22 21:45:00.154570 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.154548    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"
Jul 22 21:45:00.156104 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.156084    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:45:00.163936 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.163912    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"]
Jul 22 21:45:00.165753 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.165731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"]
Jul 22 21:45:00.168038 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.168022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"
Jul 22 21:45:00.175843 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.175818    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"
Jul 22 21:45:00.326281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.326242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"]
Jul 22 21:45:00.331341 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:45:00.331291    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3710d75_1538_4533_bb1e_9440ae051455.slice/crio-928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c WatchSource:0}: Error finding container 928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c: Status 404 returned error can't find the container with id 928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c
Jul 22 21:45:00.348087 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.348061    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"]
Jul 22 21:45:00.349862 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:45:00.349834    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499439f2_b23f_41f1_8377_4dc9167d0a48.slice/crio-b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e WatchSource:0}: Error finding container b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e: Status 404 returned error can't find the container with id b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e
Jul 22 21:45:00.472654 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.472622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb" event={"ID":"499439f2-b23f-41f1-8377-4dc9167d0a48","Type":"ContainerStarted","Data":"b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e"}
Jul 22 21:45:00.473702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:00.473679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs" event={"ID":"e3710d75-1538-4533-bb1e-9440ae051455","Type":"ContainerStarted","Data":"928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c"}
Jul 22 21:45:01.481335 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:01.481302    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb" event={"ID":"499439f2-b23f-41f1-8377-4dc9167d0a48","Type":"ContainerStarted","Data":"0e18f73f69852dd83264397f5fec2accaa6d89265da84dbe38c7343f587490ae"}
Jul 22 21:45:01.483061 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:01.483036    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs" event={"ID":"e3710d75-1538-4533-bb1e-9440ae051455","Type":"ContainerStarted","Data":"b0cb7b9397e62c872ba76aa8c5c838bffb313b4753685f6857ad0efc051c0b09"}
Jul 22 21:45:01.501512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:01.501461    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb" podStartSLOduration=1.5014454320000001 podStartE2EDuration="1.501445432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:45:01.499661562 +0000 UTC m=+2362.837276439" watchObservedRunningTime="2026-07-22 21:45:01.501445432 +0000 UTC m=+2362.839060309"
Jul 22 21:45:01.518726 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:01.518675    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs" podStartSLOduration=1.5186549299999998 podStartE2EDuration="1.51865493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:45:01.516950817 +0000 UTC m=+2362.854565695" watchObservedRunningTime="2026-07-22 21:45:01.51865493 +0000 UTC m=+2362.856269807"
Jul 22 21:45:02.490860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:02.490827    2569 generic.go:356] "Generic (PLEG): container finished" podID="499439f2-b23f-41f1-8377-4dc9167d0a48" containerID="0e18f73f69852dd83264397f5fec2accaa6d89265da84dbe38c7343f587490ae" exitCode=0
Jul 22 21:45:02.491350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:02.490913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb" event={"ID":"499439f2-b23f-41f1-8377-4dc9167d0a48","Type":"ContainerDied","Data":"0e18f73f69852dd83264397f5fec2accaa6d89265da84dbe38c7343f587490ae"}
Jul 22 21:45:02.492582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:02.492559    2569 generic.go:356] "Generic (PLEG): container finished" podID="e3710d75-1538-4533-bb1e-9440ae051455" containerID="b0cb7b9397e62c872ba76aa8c5c838bffb313b4753685f6857ad0efc051c0b09" exitCode=0
Jul 22 21:45:02.492710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:02.492613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs" event={"ID":"e3710d75-1538-4533-bb1e-9440ae051455","Type":"ContainerDied","Data":"b0cb7b9397e62c872ba76aa8c5c838bffb313b4753685f6857ad0efc051c0b09"}
Jul 22 21:45:03.164560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.164431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:03.272868 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.272836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:03.412009 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.411975    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:03.412196 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.412027    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:03.499908 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.499878    2569 generic.go:356] "Generic (PLEG): container finished" podID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerID="db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763" exitCode=0
Jul 22 21:45:03.500270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.499951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerDied","Data":"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"}
Jul 22 21:45:03.500837 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.500400    2569 scope.go:117] "RemoveContainer" containerID="db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"
Jul 22 21:45:03.501646 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.501608    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:45:03.501754 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.501704    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:45:03.501800 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.501756    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:45:03.636988 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.636801    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"
Jul 22 21:45:03.678022 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:03.677998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"
Jul 22 21:45:04.509514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.509484    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerStarted","Data":"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"}
Jul 22 21:45:04.510728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.510707    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb"
Jul 22 21:45:04.510849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.510752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745945-q2lnb" event={"ID":"499439f2-b23f-41f1-8377-4dc9167d0a48","Type":"ContainerDied","Data":"b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e"}
Jul 22 21:45:04.510849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.510798    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7bebd02825f372e55fa40762b4ec62cd2e871de31595e3a3b2c91308b63a66e"
Jul 22 21:45:04.512023 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.511997    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"
Jul 22 21:45:04.512023 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.512004    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs" event={"ID":"e3710d75-1538-4533-bb1e-9440ae051455","Type":"ContainerDied","Data":"928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c"}
Jul 22 21:45:04.512185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.512044    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="928fe9259e2e3d57217e080ef0eb0c49f5bf2f5f63d5755d22c629953f6aea7c"
Jul 22 21:45:04.782810 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.782718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:45:04.782989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.782919    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:04.782989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:04.782963    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:05.783084 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:05.783047    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:05.783576 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:05.783112    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:05.973065 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:05.973025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:06.783824 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:06.783787    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:06.784459 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:06.784417    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:07.785161 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:07.783111    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:07.785161 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:07.783198    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:08.783654 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:08.783622    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 22 21:45:08.783931 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:08.783897    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 22 21:45:09.787699 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:09.787675    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:45:09.788270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:09.788033    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:45:09.788829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:09.788811    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:45:12.105031 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:12.104998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:12.208559 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:12.208530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:27.412237 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:27.412185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:45:39.261340 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:39.261304    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:45:39.266220 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:39.266200    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:45:39.366785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:45:39.366749    2569 scope.go:117] "RemoveContainer" containerID="ca33ceaf1e998b369e376111ec50f858bd16bf1ddf0d523482e96600d4647651"
Jul 22 21:46:08.971316 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:08.971227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:10.039241 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.039214    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:10.103802 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.103767    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"]
Jul 22 21:46:10.104103 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104091    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3710d75-1538-4533-bb1e-9440ae051455" containerName="cleanup"
Jul 22 21:46:10.104165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104105    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3710d75-1538-4533-bb1e-9440ae051455" containerName="cleanup"
Jul 22 21:46:10.104165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104119    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499439f2-b23f-41f1-8377-4dc9167d0a48" containerName="cleanup"
Jul 22 21:46:10.104165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104140    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="499439f2-b23f-41f1-8377-4dc9167d0a48" containerName="cleanup"
Jul 22 21:46:10.104270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104214    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3710d75-1538-4533-bb1e-9440ae051455" containerName="cleanup"
Jul 22 21:46:10.104270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.104223    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="499439f2-b23f-41f1-8377-4dc9167d0a48" containerName="cleanup"
Jul 22 21:46:10.106413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.106398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:10.112375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.112349    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:46:10.112496 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.112410    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:46:10.130179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.130158    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"]
Jul 22 21:46:10.199356 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.199323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd\" (UID: \"26622576-9e65-42b3-b389-c1fe7a56d386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:10.300749 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.300687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd\" (UID: \"26622576-9e65-42b3-b389-c1fe7a56d386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:10.301227 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.301210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd\" (UID: \"26622576-9e65-42b3-b389-c1fe7a56d386\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:10.416721 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.416692    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:10.572327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.572304    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"]
Jul 22 21:46:10.574158 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:46:10.574118    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26622576_9e65_42b3_b389_c1fe7a56d386.slice/crio-9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014 WatchSource:0}: Error finding container 9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014: Status 404 returned error can't find the container with id 9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014
Jul 22 21:46:10.821468 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:10.821403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd" event={"ID":"26622576-9e65-42b3-b389-c1fe7a56d386","Type":"ContainerStarted","Data":"9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014"}
Jul 22 21:46:11.228431 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:11.228355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:11.419980 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:11.419948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:11.827514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:11.827478    2569 generic.go:356] "Generic (PLEG): container finished" podID="26622576-9e65-42b3-b389-c1fe7a56d386" containerID="ee4d02b86d37ed8736f4342514d78d4018d1d20d79928bd20aad3a847b204c7e" exitCode=0
Jul 22 21:46:11.827692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:11.827537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd" event={"ID":"26622576-9e65-42b3-b389-c1fe7a56d386","Type":"ContainerDied","Data":"ee4d02b86d37ed8736f4342514d78d4018d1d20d79928bd20aad3a847b204c7e"}
Jul 22 21:46:12.962792 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:12.962767    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:13.121413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.121351    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca\") pod \"26622576-9e65-42b3-b389-c1fe7a56d386\" (UID: \"26622576-9e65-42b3-b389-c1fe7a56d386\") "
Jul 22 21:46:13.121702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.121680    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26622576-9e65-42b3-b389-c1fe7a56d386" (UID: "26622576-9e65-42b3-b389-c1fe7a56d386"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:13.221868 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.221842    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26622576-9e65-42b3-b389-c1fe7a56d386-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:13.839747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.839714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd" event={"ID":"26622576-9e65-42b3-b389-c1fe7a56d386","Type":"ContainerDied","Data":"9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014"}
Jul 22 21:46:13.839747 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.839742    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"
Jul 22 21:46:13.839959 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:13.839762    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7776002777605ee89e6810f4cec53d78e817a10124e2042c619f864954c014"
Jul 22 21:46:21.122970 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:21.122934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:25.235364 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:25.235327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:25.289186 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:25.289157    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"]
Jul 22 21:46:25.297614 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:25.297590    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-3fc251-jd6jd"]
Jul 22 21:46:25.825278 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:25.825236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:27.150148 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:27.150101    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26622576-9e65-42b3-b389-c1fe7a56d386" path="/var/lib/kubelet/pods/26622576-9e65-42b3-b389-c1fe7a56d386/volumes"
Jul 22 21:46:32.404935 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.404898    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:32.545309 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.545274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:32.722496 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.722421    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:46:32.722690 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.722664    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy" containerID="cri-o://5df9b1dc7f126a4369aed5b95234a19e5133a711061cf607e967e26e8ee091cc" gracePeriod=30
Jul 22 21:46:32.744179 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.744148    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:32.944242 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:32.944208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:33.062106 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.062075    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"]
Jul 22 21:46:33.062424 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.062412    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26622576-9e65-42b3-b389-c1fe7a56d386" containerName="revoke-keys"
Jul 22 21:46:33.062477 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.062426    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="26622576-9e65-42b3-b389-c1fe7a56d386" containerName="revoke-keys"
Jul 22 21:46:33.062477 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.062475    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="26622576-9e65-42b3-b389-c1fe7a56d386" containerName="revoke-keys"
Jul 22 21:46:33.064866 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.064851    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:33.069289 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.069270    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:46:33.069462 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.069445    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:46:33.079170 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.079151    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"]
Jul 22 21:46:33.181964 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.181938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2\" (UID: \"14c6f35b-191b-4e95-b075-cdf2921956a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:33.283281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.283254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2\" (UID: \"14c6f35b-191b-4e95-b075-cdf2921956a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:33.283896 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.283879    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2\" (UID: \"14c6f35b-191b-4e95-b075-cdf2921956a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:33.374672 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.374616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:33.517595 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.517573    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"]
Jul 22 21:46:33.519316 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:46:33.519290    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c6f35b_191b_4e95_b075_cdf2921956a8.slice/crio-7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3 WatchSource:0}: Error finding container 7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3: Status 404 returned error can't find the container with id 7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3
Jul 22 21:46:33.800737 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.800714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:33.902294 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.902261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:33.935954 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.935922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2" event={"ID":"14c6f35b-191b-4e95-b075-cdf2921956a8","Type":"ContainerStarted","Data":"85527b4d816e0aa595219eec62e9c0665ae4da6217350a57503a2e44937cd3f4"}
Jul 22 21:46:33.936096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.935977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2" event={"ID":"14c6f35b-191b-4e95-b075-cdf2921956a8","Type":"ContainerStarted","Data":"7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3"}
Jul 22 21:46:33.952954 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:33.952862    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2" podStartSLOduration=0.952845312 podStartE2EDuration="952.845312ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:46:33.952143327 +0000 UTC m=+2455.289758216" watchObservedRunningTime="2026-07-22 21:46:33.952845312 +0000 UTC m=+2455.290460187"
Jul 22 21:46:34.943185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:34.943156    2569 generic.go:356] "Generic (PLEG): container finished" podID="14c6f35b-191b-4e95-b075-cdf2921956a8" containerID="85527b4d816e0aa595219eec62e9c0665ae4da6217350a57503a2e44937cd3f4" exitCode=0
Jul 22 21:46:34.943557 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:34.943244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2" event={"ID":"14c6f35b-191b-4e95-b075-cdf2921956a8","Type":"ContainerDied","Data":"85527b4d816e0aa595219eec62e9c0665ae4da6217350a57503a2e44937cd3f4"}
Jul 22 21:46:36.074585 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.074560    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:36.207148 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.207055    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca\") pod \"14c6f35b-191b-4e95-b075-cdf2921956a8\" (UID: \"14c6f35b-191b-4e95-b075-cdf2921956a8\") "
Jul 22 21:46:36.207458 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.207436    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14c6f35b-191b-4e95-b075-cdf2921956a8" (UID: "14c6f35b-191b-4e95-b075-cdf2921956a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:36.308632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.308609    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c6f35b-191b-4e95-b075-cdf2921956a8-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:36.953731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.953695    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2" event={"ID":"14c6f35b-191b-4e95-b075-cdf2921956a8","Type":"ContainerDied","Data":"7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3"}
Jul 22 21:46:36.953731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.953712    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"
Jul 22 21:46:36.953929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:36.953746    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b968aedff3bc527be69c9baf9c1e7199ea0a10b49e9177983dde560793553d3"
Jul 22 21:46:37.960923 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.960896    2569 generic.go:356] "Generic (PLEG): container finished" podID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerID="5df9b1dc7f126a4369aed5b95234a19e5133a711061cf607e967e26e8ee091cc" exitCode=0
Jul 22 21:46:37.961232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.960971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerDied","Data":"5df9b1dc7f126a4369aed5b95234a19e5133a711061cf607e967e26e8ee091cc"}
Jul 22 21:46:37.961232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.961026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4" event={"ID":"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a","Type":"ContainerDied","Data":"782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b"}
Jul 22 21:46:37.961232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.961043    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="782f4b9032bee4ba32b14424de6dff870a236fa3fa0f8aa0f2e85096cb1c672b"
Jul 22 21:46:37.961232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.961057    2569 scope.go:117] "RemoveContainer" containerID="2b3c15057ca5c317465231fffc0071ce1fec465747fe05754db3516a7bd9f0b1"
Jul 22 21:46:37.971112 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:37.971090    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:46:38.020918 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.020861    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.020918 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.020894    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sfcm\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.020918 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.020913    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.020961    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.020985    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021016    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021038    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021115    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy\") pod \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\" (UID: \"a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a\") "
Jul 22 21:46:38.021149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021114    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.021557 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021356    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.021557 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021382    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.021660 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021571    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.021660 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.021634    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:38.022252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.022198    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.023506 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.023481    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:38.023588 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.023562    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:38.023828 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.023804    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm" (OuterVolumeSpecName: "kube-api-access-9sfcm") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "kube-api-access-9sfcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:38.023828 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.023806    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" (UID: "a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:46:38.122644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122613    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122643    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122651    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122659    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122667    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sfcm\" (UniqueName: \"kubernetes.io/projected/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-kube-api-access-9sfcm\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122677    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122685    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.122803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.122693    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:46:38.966584 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:38.966552    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"
Jul 22 21:46:39.023168 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:39.023118    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:46:39.031505 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:39.031483    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3fc251-openshift-default-7888cb785-qdqz4"]
Jul 22 21:46:39.151372 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:39.151345    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" path="/var/lib/kubelet/pods/a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a/volumes"
Jul 22 21:46:43.577809 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:43.577758    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:43.578407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:43.577842    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"]
Jul 22 21:46:43.579860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:43.579832    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4a3a7e-29745945-44pxs"]
Jul 22 21:46:45.150164 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:45.150112    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3710d75-1538-4533-bb1e-9440ae051455" path="/var/lib/kubelet/pods/e3710d75-1538-4533-bb1e-9440ae051455/volumes"
Jul 22 21:46:48.146803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:48.146767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:48.153013 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:48.152985    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"]
Jul 22 21:46:48.156295 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:48.156274    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4a3a7e-wpbb2"]
Jul 22 21:46:48.529987 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:48.529958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:49.150068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:49.150041    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c6f35b-191b-4e95-b075-cdf2921956a8" path="/var/lib/kubelet/pods/14c6f35b-191b-4e95-b075-cdf2921956a8/volumes"
Jul 22 21:46:54.511849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.511805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:54.586540 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.586511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:54.752532 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.752501    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:46:54.752736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.752714    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" containerID="cri-o://d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c" gracePeriod=30
Jul 22 21:46:54.779699 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.779636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:54.790302 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.790273    2569 patch_prober.go:28] interesting pod/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:46:54.790429 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:54.790325    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:46:55.105074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.104998    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:55.374891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.374818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:55.697517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697431    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:46:55.697937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697892    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:46:55.697937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697910    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:46:55.697937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697923    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:46:55.697937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697930    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:46:55.698163 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697941    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c6f35b-191b-4e95-b075-cdf2921956a8" containerName="revoke-keys"
Jul 22 21:46:55.698163 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.697949    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c6f35b-191b-4e95-b075-cdf2921956a8" containerName="revoke-keys"
Jul 22 21:46:55.698163 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.698045    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c6f35b-191b-4e95-b075-cdf2921956a8" containerName="revoke-keys"
Jul 22 21:46:55.698163 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.698058    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:46:55.700389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.700369    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.703367 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.703349    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dc356c-openshift-default-dockercfg-4qx4q\""
Jul 22 21:46:55.721745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.721723    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:46:55.737021 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.736994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:55.750109 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750230 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750236    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750298 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlktd\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.750560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.750477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851627 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851627 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851638    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851673    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851764    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.851857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlktd\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852195 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.851861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852312 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852481 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852455    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852600 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852465    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.852659 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:55.852777 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.852713    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.854291 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.854273    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.854511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.854495    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.865239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.865208    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlktd\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:55.865433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:55.865416    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token\") pod \"e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") " pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:56.010296 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:56.010271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:56.142521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:56.142496    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:46:56.143999 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:46:56.143975    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715caecd_65f1_4904_8804_18223d09337b.slice/crio-b8433c76c63df646e3c85651673749475ce02a86e59fba580ac1047de3afcb6b WatchSource:0}: Error finding container b8433c76c63df646e3c85651673749475ce02a86e59fba580ac1047de3afcb6b: Status 404 returned error can't find the container with id b8433c76c63df646e3c85651673749475ce02a86e59fba580ac1047de3afcb6b
Jul 22 21:46:56.145956 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:56.145923    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:46:56.146037 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:56.145990    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:46:56.146037 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:56.146016    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:46:57.051998 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:57.051964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerStarted","Data":"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"}
Jul 22 21:46:57.052417 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:57.052020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerStarted","Data":"b8433c76c63df646e3c85651673749475ce02a86e59fba580ac1047de3afcb6b"}
Jul 22 21:46:57.086891 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:57.086848    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podStartSLOduration=2.086834652 podStartE2EDuration="2.086834652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:46:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:46:57.084935258 +0000 UTC m=+2478.422550134" watchObservedRunningTime="2026-07-22 21:46:57.086834652 +0000 UTC m=+2478.424449528"
Jul 22 21:46:58.010495 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:58.010460    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:58.015461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:58.015436    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:58.056922 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:58.056898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:58.057651 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:58.057636    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:46:59.092382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.092341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.189009 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.188964    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.294877 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.294830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.690578 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.690537    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.816679 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.816652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.920993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.920963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:46:59.992898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:46:59.992874    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:47:00.069427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.069401    2569 generic.go:356] "Generic (PLEG): container finished" podID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerID="d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c" exitCode=0
Jul 22 21:47:00.069556 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.069444    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"
Jul 22 21:47:00.069556 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.069483    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerDied","Data":"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"}
Jul 22 21:47:00.069632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.069553    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh" event={"ID":"ab8c9188-cd2d-460d-a6f2-f91c047facd8","Type":"ContainerDied","Data":"9cade78df940c3f3c18d5896cb8c0af582b1378ea81c605f83a658146cb48e86"}
Jul 22 21:47:00.069632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.069583    2569 scope.go:117] "RemoveContainer" containerID="d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"
Jul 22 21:47:00.077963 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.077946    2569 scope.go:117] "RemoveContainer" containerID="db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"
Jul 22 21:47:00.083049 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083026    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083115    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083173    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083205    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083240    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmd8q\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083273    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083297    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs\") pod \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\" (UID: \"ab8c9188-cd2d-460d-a6f2-f91c047facd8\") "
Jul 22 21:47:00.083402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083332    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.083655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.083528    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.084081 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.084027    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:00.084081 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.084051    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.084267 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.084153    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.084267 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.084219    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.085658 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.085621    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:00.085895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.085867    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:47:00.086008 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.085913    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:00.086008 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.085990    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q" (OuterVolumeSpecName: "kube-api-access-gmd8q") pod "ab8c9188-cd2d-460d-a6f2-f91c047facd8" (UID: "ab8c9188-cd2d-460d-a6f2-f91c047facd8"). InnerVolumeSpecName "kube-api-access-gmd8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:00.086860 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.086842    2569 scope.go:117] "RemoveContainer" containerID="d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"
Jul 22 21:47:00.087174 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:47:00.087114    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c\": container with ID starting with d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c not found: ID does not exist" containerID="d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"
Jul 22 21:47:00.087260 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.087187    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c"} err="failed to get container status \"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c\": rpc error: code = NotFound desc = could not find container \"d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c\": container with ID starting with d8553f9e10f9f367a751e9164bd029ddb6ac00d1104447c88a5365aaa0d20d7c not found: ID does not exist"
Jul 22 21:47:00.087260 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.087211    2569 scope.go:117] "RemoveContainer" containerID="db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"
Jul 22 21:47:00.087472 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:47:00.087455    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763\": container with ID starting with db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763 not found: ID does not exist" containerID="db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"
Jul 22 21:47:00.087514 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.087478    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763"} err="failed to get container status \"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763\": rpc error: code = NotFound desc = could not find container \"db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763\": container with ID starting with db5220841815d07890ba9edc280e73e556d1a58d14f15b57de8d287778d1f763 not found: ID does not exist"
Jul 22 21:47:00.184160 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184091    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184163    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184289    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184315    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184332    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184346    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmd8q\" (UniqueName: \"kubernetes.io/projected/ab8c9188-cd2d-460d-a6f2-f91c047facd8-kube-api-access-gmd8q\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184359    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8c9188-cd2d-460d-a6f2-f91c047facd8-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.184529 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.184380    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8c9188-cd2d-460d-a6f2-f91c047facd8-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:00.395555 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.395518    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:47:00.399955 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:00.399925    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4a3a7e-openshift-default-5f4cd758d5-dfdjh"]
Jul 22 21:47:01.150750 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:01.150717    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" path="/var/lib/kubelet/pods/ab8c9188-cd2d-460d-a6f2-f91c047facd8/volumes"
Jul 22 21:47:03.489066 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:03.489028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:03.936936 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:03.936861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:04.217101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217033    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:47:04.217373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217360    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:04.217425 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217375    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:04.217461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217429    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:04.217461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217436    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9cbfabc-c7b1-4d3a-9fa3-8c4a3c4c8e1a" containerName="istio-proxy"
Jul 22 21:47:04.217461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.217444    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:04.220684 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.220665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.225884 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.225860    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-05d119-openshift-default-dockercfg-jncbr\""
Jul 22 21:47:04.236361 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.236336    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:47:04.314511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.314779 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.314904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.314904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.314904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb484\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.314904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.315121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.315121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.314964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.315121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.315013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.323239 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.323209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:04.415411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415387    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415518 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415518 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415739 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415819 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415819 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415722    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415819 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.415819 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb484\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416016 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.415931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.416209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416384 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.416370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.416441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.416299    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.417997 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.417978    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.418075 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.418008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.427585 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.427563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.427735 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.427717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb484\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484\") pod \"e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") " pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.531167 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.531144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:04.667352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.667327    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:47:04.668949 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:47:04.668921    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c01194_9128_4543_bbf5_bafad17ab266.slice/crio-ca949970a04e7a92afba7e04062c3866aaa3348bff0e397e5029b2830ffca1af WatchSource:0}: Error finding container ca949970a04e7a92afba7e04062c3866aaa3348bff0e397e5029b2830ffca1af: Status 404 returned error can't find the container with id ca949970a04e7a92afba7e04062c3866aaa3348bff0e397e5029b2830ffca1af
Jul 22 21:47:04.671035 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.671004    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:04.671096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.671086    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:04.671156 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.671114    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:04.869622 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:04.869538    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:05.097001 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:05.096966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerStarted","Data":"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"}
Jul 22 21:47:05.097214 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:05.097028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerStarted","Data":"ca949970a04e7a92afba7e04062c3866aaa3348bff0e397e5029b2830ffca1af"}
Jul 22 21:47:05.156176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:05.156068    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podStartSLOduration=1.156054006 podStartE2EDuration="1.156054006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:05.154435327 +0000 UTC m=+2486.492050204" watchObservedRunningTime="2026-07-22 21:47:05.156054006 +0000 UTC m=+2486.493668884"
Jul 22 21:47:05.531922 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:05.531891    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:05.536576 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:05.536553    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:06.101511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:06.101480    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:06.102454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:06.102436    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:07.222102 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:07.222070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:07.314041 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:07.314001    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:07.404152 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:07.403572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:07.771699 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:07.771649    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:08.025145 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:08.025044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:08.125564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:08.125529    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:11.726813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:11.726708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:14.014303 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.014269    2569 patch_prober.go:28] interesting pod/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:60902->10.133.0.54:15021: read: connection reset by peer" start-of-body=
Jul 22 21:47:14.014864 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.014351    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:60902->10.133.0.54:15021: read: connection reset by peer"
Jul 22 21:47:14.144097 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.144067    2569 generic.go:356] "Generic (PLEG): container finished" podID="715caecd-65f1-4904-8804-18223d09337b" containerID="0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2" exitCode=0
Jul 22 21:47:14.144281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.144152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerDied","Data":"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"}
Jul 22 21:47:14.144560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.144545    2569 scope.go:117] "RemoveContainer" containerID="0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"
Jul 22 21:47:14.145569 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.145540    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:14.145642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.145625    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:14.145743 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:14.145718    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:15.151919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:15.151886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerStarted","Data":"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"}
Jul 22 21:47:16.010682 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:16.010637    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:16.011180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:16.011148    2569 patch_prober.go:28] interesting pod/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 21:47:16.011283 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:16.011233    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 21:47:17.010974 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:17.010934    2569 patch_prober.go:28] interesting pod/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 21:47:17.011981 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:17.011540    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 21:47:18.010965 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:18.010927    2569 patch_prober.go:28] interesting pod/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 21:47:18.011308 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:18.011262    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 21:47:19.014904 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.014872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:19.015389 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.015282    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:19.016005 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.015985    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:19.694294 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.694262    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"]
Jul 22 21:47:19.694999 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.694974    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:19.695168 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.695154    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8c9188-cd2d-460d-a6f2-f91c047facd8" containerName="istio-proxy"
Jul 22 21:47:19.697811 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.697795    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:19.700483 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.700463    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:47:19.700849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.700829    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:47:19.705858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.705826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"]
Jul 22 21:47:19.864811 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.864782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6\" (UID: \"65014e1f-65e4-4c18-8b55-ac30e6697e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:19.965855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.965774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6\" (UID: \"65014e1f-65e4-4c18-8b55-ac30e6697e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:19.966410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:19.966387    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6\" (UID: \"65014e1f-65e4-4c18-8b55-ac30e6697e79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:20.015148 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:20.015093    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:20.151848 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:20.151822    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"]
Jul 22 21:47:20.154550 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:47:20.154519    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65014e1f_65e4_4c18_8b55_ac30e6697e79.slice/crio-aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3 WatchSource:0}: Error finding container aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3: Status 404 returned error can't find the container with id aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3
Jul 22 21:47:20.178710 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:20.178682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6" event={"ID":"65014e1f-65e4-4c18-8b55-ac30e6697e79","Type":"ContainerStarted","Data":"aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3"}
Jul 22 21:47:20.286648 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:20.286604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:20.386990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:20.386949    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:21.186188 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:21.186155    2569 generic.go:356] "Generic (PLEG): container finished" podID="65014e1f-65e4-4c18-8b55-ac30e6697e79" containerID="c1c84a15f663f580f6d1be738331060b62b69df35bafc7ff6fba2571cdcfa3c5" exitCode=0
Jul 22 21:47:21.186563 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:21.186233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6" event={"ID":"65014e1f-65e4-4c18-8b55-ac30e6697e79","Type":"ContainerDied","Data":"c1c84a15f663f580f6d1be738331060b62b69df35bafc7ff6fba2571cdcfa3c5"}
Jul 22 21:47:22.142268 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.142233    2569 patch_prober.go:28] interesting pod/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 21:47:22.142431 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.142280    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 21:47:22.321543 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.321521    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:22.491114 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.491089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca\") pod \"65014e1f-65e4-4c18-8b55-ac30e6697e79\" (UID: \"65014e1f-65e4-4c18-8b55-ac30e6697e79\") "
Jul 22 21:47:22.491461 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.491434    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65014e1f-65e4-4c18-8b55-ac30e6697e79" (UID: "65014e1f-65e4-4c18-8b55-ac30e6697e79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:22.592087 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:22.592059    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65014e1f-65e4-4c18-8b55-ac30e6697e79-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:23.198421 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.198390    2569 generic.go:356] "Generic (PLEG): container finished" podID="96c01194-9128-4543-bbf5-bafad17ab266" containerID="8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e" exitCode=0
Jul 22 21:47:23.198589 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.198456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerDied","Data":"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"}
Jul 22 21:47:23.198948 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.198921    2569 scope.go:117] "RemoveContainer" containerID="8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"
Jul 22 21:47:23.199888 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.199866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6" event={"ID":"65014e1f-65e4-4c18-8b55-ac30e6697e79","Type":"ContainerDied","Data":"aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3"}
Jul 22 21:47:23.199888 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.199882    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"
Jul 22 21:47:23.200000 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.199912    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aad0b937727fa364ffe47d4d9efbbccd1efb90eb82748c5985acfac8434214c3"
Jul 22 21:47:23.200000 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.199977    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:23.200074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.200040    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:23.200074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:23.200069    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:47:24.210779 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:24.210737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerStarted","Data":"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"}
Jul 22 21:47:24.532099 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:24.532063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:24.532301 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:24.532253    2569 patch_prober.go:28] interesting pod/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 21:47:24.532347 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:24.532295    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 21:47:25.532194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:25.532160    2569 patch_prober.go:28] interesting pod/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 21:47:25.532565 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:25.532215    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 21:47:26.531954 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:26.531922    2569 patch_prober.go:28] interesting pod/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 21:47:26.532158 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:26.531975    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 21:47:27.531536 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:27.531496    2569 patch_prober.go:28] interesting pod/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 21:47:27.531946 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:27.531569    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 21:47:28.535744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:28.535714    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:28.536247 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:28.536093    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:28.536937 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:28.536906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:47:28.965376 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:28.965289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:29.067837 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:29.067803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:30.248400 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:30.248317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:30.347726 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:30.347694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:35.596215 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:35.596170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:39.392228 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:39.392185    2569 scope.go:117] "RemoveContainer" containerID="86e363ca7fa3bf35c7daf32d52669c9271279af1e54c7f8780ff6c2f5967d3cd"
Jul 22 21:47:39.772443 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:39.772413    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"]
Jul 22 21:47:39.773879 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:39.773846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:39.774388 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:39.774369    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc356c-gfrd6"]
Jul 22 21:47:40.158278 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:40.158185    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:40.367547 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:40.367500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:40.447977 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:40.447905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:41.150692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:41.150659    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65014e1f-65e4-4c18-8b55-ac30e6697e79" path="/var/lib/kubelet/pods/65014e1f-65e4-4c18-8b55-ac30e6697e79/volumes"
Jul 22 21:47:46.261811 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:46.261745    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:46.347765 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:46.347731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:46.478336 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:46.478305    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:47:46.478623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:46.478595    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" containerID="cri-o://15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec" gracePeriod=30
Jul 22 21:47:47.863063 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:47.863028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:47:49.017707 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:49.017666    2569 patch_prober.go:28] interesting pod/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:47:49.018072 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:49.017726    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:47:51.728992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.728970    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:51.826423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826338    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826392    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826423 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826420    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826483    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826540    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826692 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826577    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.826890 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826735    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:51.826890 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826759    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:51.826890 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826751    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:51.827044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826950    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:51.827044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.826999    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlktd\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.827044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827027    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token\") pod \"715caecd-65f1-4904-8804-18223d09337b\" (UID: \"715caecd-65f1-4904-8804-18223d09337b\") "
Jul 22 21:47:51.827306 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827289    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/715caecd-65f1-4904-8804-18223d09337b-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.827371 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827310    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.827371 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827323    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.827371 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827335    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.827624 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.827594    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data" (OuterVolumeSpecName: "istio-data") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:51.828852 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.828822    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:47:51.828958 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.828901    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:47:51.828958 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.828916    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd" (OuterVolumeSpecName: "kube-api-access-rlktd") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "kube-api-access-rlktd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:51.829252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.829237    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token" (OuterVolumeSpecName: "istio-token") pod "715caecd-65f1-4904-8804-18223d09337b" (UID: "715caecd-65f1-4904-8804-18223d09337b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:51.927727 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.927702    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/715caecd-65f1-4904-8804-18223d09337b-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.927727 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.927726    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.927870 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.927735    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlktd\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-kube-api-access-rlktd\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.927870 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.927745    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/715caecd-65f1-4904-8804-18223d09337b-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:51.927870 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:51.927755    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/715caecd-65f1-4904-8804-18223d09337b-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:47:52.356186 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.356156    2569 generic.go:356] "Generic (PLEG): container finished" podID="715caecd-65f1-4904-8804-18223d09337b" containerID="15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec" exitCode=0
Jul 22 21:47:52.356352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.356194    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"
Jul 22 21:47:52.356352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.356238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerDied","Data":"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"}
Jul 22 21:47:52.356352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.356293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt" event={"ID":"715caecd-65f1-4904-8804-18223d09337b","Type":"ContainerDied","Data":"b8433c76c63df646e3c85651673749475ce02a86e59fba580ac1047de3afcb6b"}
Jul 22 21:47:52.356352 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.356314    2569 scope.go:117] "RemoveContainer" containerID="15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"
Jul 22 21:47:52.365314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.365297    2569 scope.go:117] "RemoveContainer" containerID="0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"
Jul 22 21:47:52.373067 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.373050    2569 scope.go:117] "RemoveContainer" containerID="15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"
Jul 22 21:47:52.373333 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:47:52.373314    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec\": container with ID starting with 15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec not found: ID does not exist" containerID="15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"
Jul 22 21:47:52.373391 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.373340    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec"} err="failed to get container status \"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec\": rpc error: code = NotFound desc = could not find container \"15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec\": container with ID starting with 15bcb70151e3a40e425e0cb1f7d49ead5b28cb403df93f55bbe34b21f74c25ec not found: ID does not exist"
Jul 22 21:47:52.373391 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.373357    2569 scope.go:117] "RemoveContainer" containerID="0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"
Jul 22 21:47:52.373579 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:47:52.373562    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2\": container with ID starting with 0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2 not found: ID does not exist" containerID="0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"
Jul 22 21:47:52.373617 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.373585    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2"} err="failed to get container status \"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2\": rpc error: code = NotFound desc = could not find container \"0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2\": container with ID starting with 0b210947eeb4f96256f827d139612e87ffff451d766991b8247419f297faaec2 not found: ID does not exist"
Jul 22 21:47:52.377473 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.377452    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:47:52.381548 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:52.381527    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dc356c-openshift-default-5cd8f78d8c-xzvdt"]
Jul 22 21:47:53.150222 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:47:53.150192    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="715caecd-65f1-4904-8804-18223d09337b" path="/var/lib/kubelet/pods/715caecd-65f1-4904-8804-18223d09337b/volumes"
Jul 22 21:48:02.692203 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:02.692171    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:06.943791 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:06.943752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:07.370638 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:07.370593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:13.438193 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.438155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:13.625446 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.625396    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:13.695051 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.694974    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:48:13.695255 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.695234    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy" containerID="cri-o://5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83" gracePeriod=30
Jul 22 21:48:13.744524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.744493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:13.954539 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:13.954452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:14.288702 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.288652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:14.701350 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701272    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701602    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701612    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701620    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65014e1f-65e4-4c18-8b55-ac30e6697e79" containerName="revoke-keys"
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701625    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="65014e1f-65e4-4c18-8b55-ac30e6697e79" containerName="revoke-keys"
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701632    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701685 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701637    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701696    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701704    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="715caecd-65f1-4904-8804-18223d09337b" containerName="istio-proxy"
Jul 22 21:48:14.701867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.701710    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="65014e1f-65e4-4c18-8b55-ac30e6697e79" containerName="revoke-keys"
Jul 22 21:48:14.706353 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.706337    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.709521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.709502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bddd55-openshift-default-dockercfg-hs442\""
Jul 22 21:48:14.735185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.735161    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:48:14.758561 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.758530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:14.830797 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.830945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.830945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.830945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.830945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.830945 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830919    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.831165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.830961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4b7\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.831165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.831055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.831165 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.831082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932462    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.932874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4b7\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.933095 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.932935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.933240 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.933218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.933407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.933381    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.933494 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.933464    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.933606 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.933532    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.934973 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.934951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.935609 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.935593    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.942083 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.942059    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4b7\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.942241 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.942220    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token\") pod \"e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") " pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:14.971662 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:14.971606    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:15.015857 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.015835    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:15.214697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.214670    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:48:15.215734 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:48:15.215708    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec20c5f_4a49_4c2c_91f1_ff200d37e802.slice/crio-30f2ba3efabf267f122fb7bdf39de9de7c71bbb250d8c44dd732642287b94949 WatchSource:0}: Error finding container 30f2ba3efabf267f122fb7bdf39de9de7c71bbb250d8c44dd732642287b94949: Status 404 returned error can't find the container with id 30f2ba3efabf267f122fb7bdf39de9de7c71bbb250d8c44dd732642287b94949
Jul 22 21:48:15.217910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.217877    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:15.217994 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.217950    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:15.217994 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.217980    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:15.470454 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.470416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerStarted","Data":"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"}
Jul 22 21:48:15.470617 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:15.470473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerStarted","Data":"30f2ba3efabf267f122fb7bdf39de9de7c71bbb250d8c44dd732642287b94949"}
Jul 22 21:48:16.016642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:16.016612    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:16.021262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:16.021230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:16.062297 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:16.062252    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podStartSLOduration=2.062237588 podStartE2EDuration="2.062237588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:48:15.515709777 +0000 UTC m=+2556.853324653" watchObservedRunningTime="2026-07-22 21:48:16.062237588 +0000 UTC m=+2557.399852512"
Jul 22 21:48:16.475708 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:16.475626    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:16.476407 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:16.476384    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:17.532846 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:17.532803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:17.649436 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:17.649406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:17.760787 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:17.760755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:18.216363 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:18.216329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:18.467205 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:18.467110    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:18.565913 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:18.565884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:18.942546 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:18.942522    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:48:19.067373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067307    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067339    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067361    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067382    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067439    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb484\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067523    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067623 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token\") pod \"96c01194-9128-4543-bbf5-bafad17ab266\" (UID: \"96c01194-9128-4543-bbf5-bafad17ab266\") "
Jul 22 21:48:19.067926 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067642    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:48:19.067926 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067791    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.067926 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067852    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:48:19.067926 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.067893    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:48:19.068246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.068217    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:48:19.068526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.068306    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data" (OuterVolumeSpecName: "istio-data") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:48:19.069496 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.069473    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:48:19.069839 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.069821    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token" (OuterVolumeSpecName: "istio-token") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:48:19.070062 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.070042    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484" (OuterVolumeSpecName: "kube-api-access-qb484") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "kube-api-access-qb484". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:48:19.070105 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.070050    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96c01194-9128-4543-bbf5-bafad17ab266" (UID: "96c01194-9128-4543-bbf5-bafad17ab266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:48:19.168834 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168812    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168834 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168832    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96c01194-9128-4543-bbf5-bafad17ab266-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168841    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168849    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb484\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-kube-api-access-qb484\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168857    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168865    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96c01194-9128-4543-bbf5-bafad17ab266-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168872    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96c01194-9128-4543-bbf5-bafad17ab266-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.168960 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.168879    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96c01194-9128-4543-bbf5-bafad17ab266-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:48:19.498744 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.498715    2569 generic.go:356] "Generic (PLEG): container finished" podID="96c01194-9128-4543-bbf5-bafad17ab266" containerID="5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83" exitCode=0
Jul 22 21:48:19.498919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.498767    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"
Jul 22 21:48:19.498919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.498801    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerDied","Data":"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"}
Jul 22 21:48:19.498919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.498851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h" event={"ID":"96c01194-9128-4543-bbf5-bafad17ab266","Type":"ContainerDied","Data":"ca949970a04e7a92afba7e04062c3866aaa3348bff0e397e5029b2830ffca1af"}
Jul 22 21:48:19.498919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.498876    2569 scope.go:117] "RemoveContainer" containerID="5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"
Jul 22 21:48:19.507037 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.507025    2569 scope.go:117] "RemoveContainer" containerID="8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"
Jul 22 21:48:19.514489 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.514473    2569 scope.go:117] "RemoveContainer" containerID="5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"
Jul 22 21:48:19.514732 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:48:19.514714    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83\": container with ID starting with 5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83 not found: ID does not exist" containerID="5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"
Jul 22 21:48:19.514777 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.514740    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83"} err="failed to get container status \"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83\": rpc error: code = NotFound desc = could not find container \"5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83\": container with ID starting with 5be6a8fd50257221df9db9ea1847090f5bdab6af21f6f83b171ddd13a935cc83 not found: ID does not exist"
Jul 22 21:48:19.514777 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.514753    2569 scope.go:117] "RemoveContainer" containerID="8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"
Jul 22 21:48:19.514959 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:48:19.514941    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e\": container with ID starting with 8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e not found: ID does not exist" containerID="8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"
Jul 22 21:48:19.515002 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.514964    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e"} err="failed to get container status \"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e\": rpc error: code = NotFound desc = could not find container \"8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e\": container with ID starting with 8df3b289cac9b3ce8f1b246af82a03bc8f09d9eae0310ba0a54beac5a93c997e not found: ID does not exist"
Jul 22 21:48:19.526024 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.526004    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:48:19.531380 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:19.531357    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-05d119-openshift-default-6cdd8d7849-7dt8h"]
Jul 22 21:48:21.150281 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:21.150250    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c01194-9128-4543-bbf5-bafad17ab266" path="/var/lib/kubelet/pods/96c01194-9128-4543-bbf5-bafad17ab266/volumes"
Jul 22 21:48:22.059325 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.059291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:22.370867 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.370785    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:22.676818 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.676748    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:48:22.677077 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677066    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.677121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677079    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.677121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677087    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.677121 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677092    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.677236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677168    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.677236 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.677180    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c01194-9128-4543-bbf5-bafad17ab266" containerName="istio-proxy"
Jul 22 21:48:22.683700 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.683673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.687041 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.687009    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e44515-openshift-default-dockercfg-rlwrb\""
Jul 22 21:48:22.704640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.704612    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:48:22.742775 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.742748    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:22.794403 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794495    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794583 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv675\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794607    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.794798 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.794712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.895831 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.895795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.895831 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.895837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.895855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.895962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.895979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv675\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896068 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896397 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896082    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896397 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896672    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896731 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.896894 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.896877    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.898718 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.898691    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.898898 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.898881    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.904783 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.904765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.905225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.905191    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv675\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675\") pod \"e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") " pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.994504 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.994473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:22.999764 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:22.999737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:23.134096 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.134066    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:48:23.134999 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:48:23.134978    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f09914b_91f0_432e_b716_0c0df267d63a.slice/crio-d1499cab4b783347f9dd6d7478241d509e5a11159f7b1746a9b4bdeb23b1cca0 WatchSource:0}: Error finding container d1499cab4b783347f9dd6d7478241d509e5a11159f7b1746a9b4bdeb23b1cca0: Status 404 returned error can't find the container with id d1499cab4b783347f9dd6d7478241d509e5a11159f7b1746a9b4bdeb23b1cca0
Jul 22 21:48:23.137287 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.137250    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:23.137357 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.137329    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:23.137394 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.137374    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:23.523075 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.523036    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerStarted","Data":"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"}
Jul 22 21:48:23.523482 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.523093    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerStarted","Data":"d1499cab4b783347f9dd6d7478241d509e5a11159f7b1746a9b4bdeb23b1cca0"}
Jul 22 21:48:23.547912 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.547868    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podStartSLOduration=1.5478537860000001 podStartE2EDuration="1.547853786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:48:23.546176109 +0000 UTC m=+2564.883791000" watchObservedRunningTime="2026-07-22 21:48:23.547853786 +0000 UTC m=+2564.885468699"
Jul 22 21:48:23.994859 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:23.994818    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:25.012314 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:25.012273    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:25.532441 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:25.532418    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:25.533440 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:25.533422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:25.590256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:25.590224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:25.859198 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:25.859094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:26.065807 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:26.065776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:27.258417 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:27.258386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:27.385942 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:27.385909    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:29.985534 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:29.985497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:31.476958 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.476861    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 21:48:31.476958 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.476922    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 21:48:31.564803 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.564767    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerID="026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861" exitCode=0
Jul 22 21:48:31.564970 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.564842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerDied","Data":"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"}
Jul 22 21:48:31.565252 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.565237    2569 scope.go:117] "RemoveContainer" containerID="026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"
Jul 22 21:48:31.566207 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.566181    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:31.566290 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.566251    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:31.566290 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:31.566284    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:32.160554 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:32.160523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:32.571841 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:32.571803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerStarted","Data":"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"}
Jul 22 21:48:33.016993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:33.016949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:33.017227 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:33.017080    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 21:48:33.017227 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:33.017197    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 21:48:34.016887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:34.016839    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 21:48:34.017410 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:34.016930    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 21:48:35.016995 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:35.016956    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 21:48:35.017604 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:35.017574    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 21:48:36.016178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:36.016144    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 22 21:48:36.016375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:36.016208    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 22 21:48:37.020306 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:37.020269    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:37.020779 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:37.020640    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:37.021345 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:37.021328    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:48:38.605048 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.604968    2569 generic.go:356] "Generic (PLEG): container finished" podID="0f09914b-91f0-432e-b716-0c0df267d63a" containerID="528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1" exitCode=0
Jul 22 21:48:38.605644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.605040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerDied","Data":"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"}
Jul 22 21:48:38.605644 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.605529    2569 scope.go:117] "RemoveContainer" containerID="528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"
Jul 22 21:48:38.606476 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.606449    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:38.606572 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.606513    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:38.606572 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:38.606544    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 21:48:39.415178 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.415147    2569 scope.go:117] "RemoveContainer" containerID="27806f30ba1629e449bcfd99b50dcd8cece4010fd5b2e8b98f9275259ac83b8b"
Jul 22 21:48:39.450784 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.450760    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:39.547332 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.547300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:39.615835 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.615793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerStarted","Data":"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"}
Jul 22 21:48:39.995639 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.995606    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:39.996833 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.996805    2569 patch_prober.go:28] interesting pod/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 21:48:39.997018 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:39.996991    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 21:48:40.532993 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:40.532961    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:40.995489 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:40.995447    2569 patch_prober.go:28] interesting pod/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 21:48:40.995981 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:40.995514    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 21:48:42.001042 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:42.001000    2569 patch_prober.go:28] interesting pod/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 21:48:42.001651 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:42.001614    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 21:48:42.995271 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:42.995226    2569 patch_prober.go:28] interesting pod/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 21:48:42.995477 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:42.995293    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 21:48:43.998748 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:43.998718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:43.999917 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:43.999898    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:48:46.006107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:46.006071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:48.343584 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:48.343556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:48.443106 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:48.443075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:58.728198 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:58.728166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:48:58.826689 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:48:58.826660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:49:22.175902 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:49:22.175812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:49:40.124738 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:49:40.124701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:50:39.288680 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:50:39.288598    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:50:39.296766 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:50:39.296748    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:50:54.449101 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:50:54.449058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:51:36.634916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:51:36.634870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:51:37.470434 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:51:37.470389    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:51:39.456734 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:51:39.456702    2569 scope.go:117] "RemoveContainer" containerID="b0cb7b9397e62c872ba76aa8c5c838bffb313b4753685f6857ad0efc051c0b09"
Jul 22 21:51:39.464568 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:51:39.464550    2569 scope.go:117] "RemoveContainer" containerID="5df9b1dc7f126a4369aed5b95234a19e5133a711061cf607e967e26e8ee091cc"
Jul 22 21:51:51.718113 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:51:51.718070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:52:27.245640 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:52:27.245548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:52:39.492259 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:52:39.492219    2569 scope.go:117] "RemoveContainer" containerID="85527b4d816e0aa595219eec62e9c0665ae4da6217350a57503a2e44937cd3f4"
Jul 22 21:52:39.500225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:52:39.500201    2569 scope.go:117] "RemoveContainer" containerID="ee4d02b86d37ed8736f4342514d78d4018d1d20d79928bd20aad3a847b204c7e"
Jul 22 21:53:01.478402 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:01.478347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:04.177259 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.177222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:04.571275 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.571240    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:53:04.574575 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.574559    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.577745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.577721    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"openshift-service-ca.crt\""
Jul 22 21:53:04.579055 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.579039    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"kube-root-ca.crt\""
Jul 22 21:53:04.579180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.579164    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"default-dockercfg-sjlcf\""
Jul 22 21:53:04.579262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.579174    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"rate-test-model-bddd55-kserve-self-signed-certs\""
Jul 22 21:53:04.589582 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.589557    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:53:04.612351 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.612306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:04.749700 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.749855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.749855 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749755    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.749991 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.749991 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.749991 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.749939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8ttr\" (UniqueName: \"kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.850745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.850745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.850745 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8ttr\" (UniqueName: \"kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851006 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851006 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851006 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.850818    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851202 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.851051    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851202 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.851116    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.851326 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.851224    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.853185 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.853164    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.853469 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.853451    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.862265 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.862244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8ttr\" (UniqueName: \"kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr\") pod \"rate-test-model-bddd55-kserve-7b54bb77f5-lxld8\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") " pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:04.884191 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:04.884162    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:05.016232 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:05.016204    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:53:05.017794 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:53:05.017769    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6807907_6ad6_429d_bc53_181e971808da.slice/crio-cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769 WatchSource:0}: Error finding container cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769: Status 404 returned error can't find the container with id cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769
Jul 22 21:53:05.902802 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:05.902761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" event={"ID":"d6807907-6ad6-429d-bc53-181e971808da","Type":"ContainerStarted","Data":"b1687f3deb3a735667bf22ae726ce98b16573ab7f287a4fbee328b965ef89f44"}
Jul 22 21:53:05.903215 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:05.902811    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" event={"ID":"d6807907-6ad6-429d-bc53-181e971808da","Type":"ContainerStarted","Data":"cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769"}
Jul 22 21:53:05.941373 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:05.941326    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" podStartSLOduration=1.941310093 podStartE2EDuration="1.941310093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:53:05.938107156 +0000 UTC m=+2847.275722034" watchObservedRunningTime="2026-07-22 21:53:05.941310093 +0000 UTC m=+2847.278924970"
Jul 22 21:53:14.884775 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:14.884734    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:14.885279 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:14.884804    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:14.900506 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:14.900477    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:14.963150 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:14.963106    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:53:20.201581 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:20.201547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:27.737144 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:27.737096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:36.477631 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:36.477551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:39.523727 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:39.523697    2569 scope.go:117] "RemoveContainer" containerID="c1c84a15f663f580f6d1be738331060b62b69df35bafc7ff6fba2571cdcfa3c5"
Jul 22 21:53:40.448206 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:40.448152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:40.556427 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:40.556401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:46.368848 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:46.368815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:49.132051 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:49.132015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:49.232585 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:49.232549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:52.243778 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:52.243740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:59.597150 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:59.597064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:53:59.706003 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:53:59.705968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:23.101217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:23.101185    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:54:23.125782 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:23.125757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:24.077297 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:24.077265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:38.121166 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.121092    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" podUID="d6807907-6ad6-429d-bc53-181e971808da" containerName="main" containerID="cri-o://b1687f3deb3a735667bf22ae726ce98b16573ab7f287a4fbee328b965ef89f44" gracePeriod=45
Jul 22 21:54:38.352487 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.352454    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6807907-6ad6-429d-bc53-181e971808da" containerID="b1687f3deb3a735667bf22ae726ce98b16573ab7f287a4fbee328b965ef89f44" exitCode=0
Jul 22 21:54:38.352605 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.352515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" event={"ID":"d6807907-6ad6-429d-bc53-181e971808da","Type":"ContainerDied","Data":"b1687f3deb3a735667bf22ae726ce98b16573ab7f287a4fbee328b965ef89f44"}
Jul 22 21:54:38.352605 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.352554    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8" event={"ID":"d6807907-6ad6-429d-bc53-181e971808da","Type":"ContainerDied","Data":"cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769"}
Jul 22 21:54:38.352605 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.352568    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb6e36a78b80a767b4f3e67c504c94d5683b7883ec32ffb316b0a39a8e210769"
Jul 22 21:54:38.361740 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.361721    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:54:38.420815 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420758    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.420815 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420808    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8ttr\" (UniqueName: \"kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.421043 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420834    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.421043 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420879    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.421043 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420903    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.421043 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.420972    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm\") pod \"d6807907-6ad6-429d-bc53-181e971808da\" (UID: \"d6807907-6ad6-429d-bc53-181e971808da\") "
Jul 22 21:54:38.421254 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421163    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:54:38.421254 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421171    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home" (OuterVolumeSpecName: "home") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:54:38.421254 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421205    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:54:38.421360 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421300    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-tmp-dir\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:38.421360 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421314    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-model-cache\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:38.421360 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.421322    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-home\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:38.423059 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.423025    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm" (OuterVolumeSpecName: "dshm") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:54:38.423180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.423082    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:54:38.423180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.423107    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr" (OuterVolumeSpecName: "kube-api-access-s8ttr") pod "d6807907-6ad6-429d-bc53-181e971808da" (UID: "d6807907-6ad6-429d-bc53-181e971808da"). InnerVolumeSpecName "kube-api-access-s8ttr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:54:38.521974 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.521948    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6807907-6ad6-429d-bc53-181e971808da-dshm\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:38.521974 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.521968    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6807907-6ad6-429d-bc53-181e971808da-tls-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:38.522098 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:38.521980    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8ttr\" (UniqueName: \"kubernetes.io/projected/d6807907-6ad6-429d-bc53-181e971808da-kube-api-access-s8ttr\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:39.358382 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:39.358349    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"
Jul 22 21:54:39.375509 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:39.375480    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:54:39.379413 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:39.379387    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/rate-test-model-bddd55-kserve-7b54bb77f5-lxld8"]
Jul 22 21:54:41.149967 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:41.149936    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6807907-6ad6-429d-bc53-181e971808da" path="/var/lib/kubelet/pods/d6807907-6ad6-429d-bc53-181e971808da/volumes"
Jul 22 21:54:43.598894 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.598862    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"]
Jul 22 21:54:43.599411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.599217    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6807907-6ad6-429d-bc53-181e971808da" containerName="main"
Jul 22 21:54:43.599411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.599229    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6807907-6ad6-429d-bc53-181e971808da" containerName="main"
Jul 22 21:54:43.599411 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.599300    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6807907-6ad6-429d-bc53-181e971808da" containerName="main"
Jul 22 21:54:43.603488 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.603471    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:43.606217 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.606191    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:54:43.606325 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.606202    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:54:43.609736 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.609712    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"]
Jul 22 21:54:43.655802 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.655777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw\" (UID: \"49a2f539-4705-4197-8a33-0ab64b263e44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:43.757007 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.756980    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw\" (UID: \"49a2f539-4705-4197-8a33-0ab64b263e44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:43.757545 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.757528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw\" (UID: \"49a2f539-4705-4197-8a33-0ab64b263e44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:43.914858 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:43.914802    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:44.043974 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.043946    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"]
Jul 22 21:54:44.047164 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:54:44.047115    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a2f539_4705_4197_8a33_0ab64b263e44.slice/crio-57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24 WatchSource:0}: Error finding container 57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24: Status 404 returned error can't find the container with id 57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24
Jul 22 21:54:44.369874 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.369845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:44.383807 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.383777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw" event={"ID":"49a2f539-4705-4197-8a33-0ab64b263e44","Type":"ContainerStarted","Data":"f956e64ae3de39f6a607da994dec4d27ffb37161808d47594e30d93d278fbd1b"}
Jul 22 21:54:44.383914 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.383827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw" event={"ID":"49a2f539-4705-4197-8a33-0ab64b263e44","Type":"ContainerStarted","Data":"57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24"}
Jul 22 21:54:44.405194 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.405149    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw" podStartSLOduration=1.405119188 podStartE2EDuration="1.405119188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:54:44.404017558 +0000 UTC m=+2945.741632434" watchObservedRunningTime="2026-07-22 21:54:44.405119188 +0000 UTC m=+2945.742734109"
Jul 22 21:54:44.471100 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:44.471046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:45.391381 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:45.391346    2569 generic.go:356] "Generic (PLEG): container finished" podID="49a2f539-4705-4197-8a33-0ab64b263e44" containerID="f956e64ae3de39f6a607da994dec4d27ffb37161808d47594e30d93d278fbd1b" exitCode=0
Jul 22 21:54:45.391756 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:45.391399    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw" event={"ID":"49a2f539-4705-4197-8a33-0ab64b263e44","Type":"ContainerDied","Data":"f956e64ae3de39f6a607da994dec4d27ffb37161808d47594e30d93d278fbd1b"}
Jul 22 21:54:46.528375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:46.528352    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:46.684270 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:46.684203    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca\") pod \"49a2f539-4705-4197-8a33-0ab64b263e44\" (UID: \"49a2f539-4705-4197-8a33-0ab64b263e44\") "
Jul 22 21:54:46.684560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:46.684539    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49a2f539-4705-4197-8a33-0ab64b263e44" (UID: "49a2f539-4705-4197-8a33-0ab64b263e44"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:54:46.785524 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:46.785505    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49a2f539-4705-4197-8a33-0ab64b263e44-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:54:47.402598 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:47.402568    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"
Jul 22 21:54:47.402759 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:47.402603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw" event={"ID":"49a2f539-4705-4197-8a33-0ab64b263e44","Type":"ContainerDied","Data":"57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24"}
Jul 22 21:54:47.402759 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:47.402656    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57d0dd85eb0429a8cdc12831ca7481af055e867f930d3e676fab50632cc91d24"
Jul 22 21:54:54.098295 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:54.098267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:58.691787 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:58.691751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:58.698617 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:58.698589    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"]
Jul 22 21:54:58.703245 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:58.703224    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bddd55-ntpjw"]
Jul 22 21:54:59.057321 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:59.057291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:54:59.150564 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:54:59.150537    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a2f539-4705-4197-8a33-0ab64b263e44" path="/var/lib/kubelet/pods/49a2f539-4705-4197-8a33-0ab64b263e44/volumes"
Jul 22 21:55:05.247813 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.247739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:05.322517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.322486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:05.492406 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.492375    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:55:05.492648 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.492619    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" containerID="cri-o://3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60" gracePeriod=30
Jul 22 21:55:05.530171 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.530072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:05.744793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.744755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:05.850012 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.849943    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"]
Jul 22 21:55:05.850291 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.850279    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a2f539-4705-4197-8a33-0ab64b263e44" containerName="revoke-keys"
Jul 22 21:55:05.850337 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.850293    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a2f539-4705-4197-8a33-0ab64b263e44" containerName="revoke-keys"
Jul 22 21:55:05.850369 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.850355    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a2f539-4705-4197-8a33-0ab64b263e44" containerName="revoke-keys"
Jul 22 21:55:05.853322 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.853306    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:05.856310 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.856293    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:55:05.856433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.856410    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:55:05.863962 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:05.863936    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"]
Jul 22 21:55:06.027849 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.027824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv\" (UID: \"178377b6-91ce-4659-a279-3a798909ea2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:06.128673 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.128600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv\" (UID: \"178377b6-91ce-4659-a279-3a798909ea2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:06.129246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.129226    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv\" (UID: \"178377b6-91ce-4659-a279-3a798909ea2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:06.162650 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.162627    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:06.292894 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.292871    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"]
Jul 22 21:55:06.295055 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:55:06.295019    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178377b6_91ce_4659_a279_3a798909ea2b.slice/crio-a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9 WatchSource:0}: Error finding container a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9: Status 404 returned error can't find the container with id a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9
Jul 22 21:55:06.370544 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.370518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:06.471532 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.471460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:06.491868 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:06.491835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv" event={"ID":"178377b6-91ce-4659-a279-3a798909ea2b","Type":"ContainerStarted","Data":"a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9"}
Jul 22 21:55:07.023225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:07.023193    2569 patch_prober.go:28] interesting pod/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:55:07.023327 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:07.023240    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:55:07.497998 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:07.497964    2569 generic.go:356] "Generic (PLEG): container finished" podID="178377b6-91ce-4659-a279-3a798909ea2b" containerID="0fb12789f731612f85247df7ca253d4a5b4e3587f118937a49a1fbfab78dbafd" exitCode=0
Jul 22 21:55:07.498384 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:07.498051    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv" event={"ID":"178377b6-91ce-4659-a279-3a798909ea2b","Type":"ContainerDied","Data":"0fb12789f731612f85247df7ca253d4a5b4e3587f118937a49a1fbfab78dbafd"}
Jul 22 21:55:08.639632 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:08.639607    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:08.749791 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:08.749753    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca\") pod \"178377b6-91ce-4659-a279-3a798909ea2b\" (UID: \"178377b6-91ce-4659-a279-3a798909ea2b\") "
Jul 22 21:55:08.750063 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:08.750042    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "178377b6-91ce-4659-a279-3a798909ea2b" (UID: "178377b6-91ce-4659-a279-3a798909ea2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:55:08.851056 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:08.850994    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/178377b6-91ce-4659-a279-3a798909ea2b-maas-api-service-ca\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:09.508910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:09.508886    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"
Jul 22 21:55:09.509074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:09.508928    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv" event={"ID":"178377b6-91ce-4659-a279-3a798909ea2b","Type":"ContainerDied","Data":"a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9"}
Jul 22 21:55:09.509074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:09.508984    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a63cfd7cf0c9190f88c93f351f58ed8690329a985bf8faabf37e0bcfdd8e59b9"
Jul 22 21:55:10.735832 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.735811    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:55:10.870436 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870370    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870436 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870402    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870440    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870459    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx4b7\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870495    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870533    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870553    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870584    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870642 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870617    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy\") pod \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\" (UID: \"1ec20c5f-4a49-4c2c-91f1-ff200d37e802\") "
Jul 22 21:55:10.870992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870644    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:10.870992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870718    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:10.870992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870903    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.870992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870913    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:55:10.870992 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.870924    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.871433 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.871119    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:10.871612 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.871589    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:10.872829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.872798    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:55:10.872942 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.872827    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:10.873107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.873086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:55:10.873107 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.873090    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7" (OuterVolumeSpecName: "kube-api-access-xx4b7") pod "1ec20c5f-4a49-4c2c-91f1-ff200d37e802" (UID: "1ec20c5f-4a49-4c2c-91f1-ff200d37e802"). InnerVolumeSpecName "kube-api-access-xx4b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:55:10.971478 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971453    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971478 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971474    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971483    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971491    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971499    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971507    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:10.971608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:10.971514    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx4b7\" (UniqueName: \"kubernetes.io/projected/1ec20c5f-4a49-4c2c-91f1-ff200d37e802-kube-api-access-xx4b7\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:11.519664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.519630    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerID="3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60" exitCode=0
Jul 22 21:55:11.519786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.519693    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"
Jul 22 21:55:11.519786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.519714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerDied","Data":"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"}
Jul 22 21:55:11.519786 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.519767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp" event={"ID":"1ec20c5f-4a49-4c2c-91f1-ff200d37e802","Type":"ContainerDied","Data":"30f2ba3efabf267f122fb7bdf39de9de7c71bbb250d8c44dd732642287b94949"}
Jul 22 21:55:11.519920 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.519791    2569 scope.go:117] "RemoveContainer" containerID="3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"
Jul 22 21:55:11.528122 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.528105    2569 scope.go:117] "RemoveContainer" containerID="026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"
Jul 22 21:55:11.535405 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.535391    2569 scope.go:117] "RemoveContainer" containerID="3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"
Jul 22 21:55:11.535665 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:55:11.535644    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60\": container with ID starting with 3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60 not found: ID does not exist" containerID="3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"
Jul 22 21:55:11.535715 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.535672    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60"} err="failed to get container status \"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60\": rpc error: code = NotFound desc = could not find container \"3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60\": container with ID starting with 3a9eb3720e5222b712302bca3f07e37da86fa8302695f2057a42c509110d7b60 not found: ID does not exist"
Jul 22 21:55:11.535715 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.535693    2569 scope.go:117] "RemoveContainer" containerID="026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"
Jul 22 21:55:11.535933 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:55:11.535917    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861\": container with ID starting with 026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861 not found: ID does not exist" containerID="026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"
Jul 22 21:55:11.535978 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.535937    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861"} err="failed to get container status \"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861\": rpc error: code = NotFound desc = could not find container \"026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861\": container with ID starting with 026c9a1b3cd59c35f7912b8a2fb3f8e737bbec1e998bbe8561f7ca8da69b3861 not found: ID does not exist"
Jul 22 21:55:11.540366 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.540345    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:55:11.544655 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:11.544625    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bddd55-openshift-default-766d5d6f95-sw4fp"]
Jul 22 21:55:13.150656 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:13.150623    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" path="/var/lib/kubelet/pods/1ec20c5f-4a49-4c2c-91f1-ff200d37e802/volumes"
Jul 22 21:55:16.737039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:16.737009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:20.928652 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:20.928618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:20.929032 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:20.928874    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"]
Jul 22 21:55:20.932521 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:20.932494    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e44515-5f6pv"]
Jul 22 21:55:21.150942 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:21.150913    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="178377b6-91ce-4659-a279-3a798909ea2b" path="/var/lib/kubelet/pods/178377b6-91ce-4659-a279-3a798909ea2b/volumes"
Jul 22 21:55:21.300806 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:21.300777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:27.577723 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:27.577689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:27.677903 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:27.677875    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:27.829740 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:27.829652    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:55:27.829910 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:27.829869    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" containerID="cri-o://b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b" gracePeriod=30
Jul 22 21:55:27.858385 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:27.858357    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:28.068085 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:28.068057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:29.001553 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:29.001518    2569 patch_prober.go:28] interesting pod/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 21:55:29.001919 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:29.001612    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:55:33.078768 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.078741    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:55:33.138039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.137985    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138039 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138026    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138045    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138085    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138104    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv675\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138225 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138203    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138458 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138239    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138458 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138274    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo\") pod \"0f09914b-91f0-432e-b716-0c0df267d63a\" (UID: \"0f09914b-91f0-432e-b716-0c0df267d63a\") "
Jul 22 21:55:33.138571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138496    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:33.138571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138519    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:33.138571 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138539    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:33.138941 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138913    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:33.139048 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.138994    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:55:33.140300 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.140271    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:55:33.140387 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.140365    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 21:55:33.140887 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.140855    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675" (OuterVolumeSpecName: "kube-api-access-jv675") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "kube-api-access-jv675". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:55:33.140983 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.140884    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f09914b-91f0-432e-b716-0c0df267d63a" (UID: "0f09914b-91f0-432e-b716-0c0df267d63a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:55:33.238943 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238914    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-data\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.238943 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238938    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238953    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv675\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-kube-api-access-jv675\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238966    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-credential-socket\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238978    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-istio-envoy\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.238989    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f09914b-91f0-432e-b716-0c0df267d63a-istio-podinfo\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.239000    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f09914b-91f0-432e-b716-0c0df267d63a-istiod-ca-cert\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.239012    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f09914b-91f0-432e-b716-0c0df267d63a-istio-token\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.239090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.239023    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f09914b-91f0-432e-b716-0c0df267d63a-workload-certs\") on node \"ip-10-0-142-246.ec2.internal\" DevicePath \"\""
Jul 22 21:55:33.624780 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.624757    2569 generic.go:356] "Generic (PLEG): container finished" podID="0f09914b-91f0-432e-b716-0c0df267d63a" containerID="b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b" exitCode=0
Jul 22 21:55:33.624895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.624806    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"
Jul 22 21:55:33.624895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.624836    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerDied","Data":"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"}
Jul 22 21:55:33.624895 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.624892    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4" event={"ID":"0f09914b-91f0-432e-b716-0c0df267d63a","Type":"ContainerDied","Data":"d1499cab4b783347f9dd6d7478241d509e5a11159f7b1746a9b4bdeb23b1cca0"}
Jul 22 21:55:33.625002 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.624921    2569 scope.go:117] "RemoveContainer" containerID="b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"
Jul 22 21:55:33.633479 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.633459    2569 scope.go:117] "RemoveContainer" containerID="528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"
Jul 22 21:55:33.640989 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.640972    2569 scope.go:117] "RemoveContainer" containerID="b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"
Jul 22 21:55:33.641246 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:55:33.641230    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b\": container with ID starting with b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b not found: ID does not exist" containerID="b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"
Jul 22 21:55:33.641331 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.641259    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b"} err="failed to get container status \"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b\": rpc error: code = NotFound desc = could not find container \"b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b\": container with ID starting with b126d8b48766026e3c2c11d023a8fd8d572bf566cbb345776cf9ed65a87e3a0b not found: ID does not exist"
Jul 22 21:55:33.641331 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.641283    2569 scope.go:117] "RemoveContainer" containerID="528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"
Jul 22 21:55:33.641526 ip-10-0-142-246 kubenswrapper[2569]: E0722 21:55:33.641507    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1\": container with ID starting with 528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1 not found: ID does not exist" containerID="528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"
Jul 22 21:55:33.641567 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.641534    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1"} err="failed to get container status \"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1\": rpc error: code = NotFound desc = could not find container \"528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1\": container with ID starting with 528ad8face6a9d08dea3cfeb5f7d9a519e0184464c1587cdef29f555913808e1 not found: ID does not exist"
Jul 22 21:55:33.645793 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.645775    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:55:33.650801 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.650781    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e44515-openshift-default-7595577bd7-6jjv4"]
Jul 22 21:55:33.889896 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:33.889838    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4pdhk_ffc53625-d872-472c-8630-73d114818d8a/manager/0.log"
Jul 22 21:55:34.238560 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:34.238542    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wm56c_f14b3603-e793-4ce0-9cf7-11a64262d044/server/0.log"
Jul 22 21:55:34.358246 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:34.358218    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fd7gz_f475fbcc-8b3a-4394-9e7e-1faf9e6c3414/manager/0.log"
Jul 22 21:55:34.586839 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:34.586781    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-55m2h_31077411-67b0-4bcb-a206-dac4a35ba902/copy-manifests/0.log"
Jul 22 21:55:34.598684 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:34.598661    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-55m2h_31077411-67b0-4bcb-a206-dac4a35ba902/manager/0.log"
Jul 22 21:55:35.150176 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:35.150147    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" path="/var/lib/kubelet/pods/0f09914b-91f0-432e-b716-0c0df267d63a/volumes"
Jul 22 21:55:35.166799 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:35.166777    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745930-55x66_df49f30a-7f4a-4a85-84ea-9216eb2a3677/cleanup/0.log"
Jul 22 21:55:35.269724 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:35.269694    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745945-q2lnb_499439f2-b23f-41f1-8377-4dc9167d0a48/cleanup/0.log"
Jul 22 21:55:36.395916 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:36.395890    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/util/0.log"
Jul 22 21:55:36.402665 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:36.402644    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/pull/0.log"
Jul 22 21:55:36.410308 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:36.410290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/extract/0.log"
Jul 22 21:55:36.778846 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:36.778817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2mxg6_6c7f2362-8730-427e-893c-9b5b20247054/manager/0.log"
Jul 22 21:55:36.888090 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:36.888063    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f6mbv_d83ce69c-321b-4c83-9c3f-c87e626b4a5a/manager/0.log"
Jul 22 21:55:37.111250 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:37.111181    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9lj9s_a65fd718-0087-4668-9dca-b87565712c56/registry-server/0.log"
Jul 22 21:55:37.230779 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:37.230753    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zvp77_9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7/manager/0.log"
Jul 22 21:55:37.932633 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:37.932596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w77kh_dce60bb0-8b90-4da0-8c15-3e438d2fd574/discovery/0.log"
Jul 22 21:55:38.038778 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:38.038752    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-bl4zn_595d0fae-89d4-475a-a136-f5af667d9aa3/kube-auth-proxy/0.log"
Jul 22 21:55:38.496401 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:38.496374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p2f96_d0adb0dc-70b6-4cae-b882-be3c57576650/payload-processing/0.log"
Jul 22 21:55:38.947426 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:38.947327    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vvqht_894aca74-531d-420f-a959-d6a7a397ba6c/main/0.log"
Jul 22 21:55:39.170814 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:39.170785    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gjbcq_cf5c078d-553b-405c-b1a2-cbcb0a4f6758/main/0.log"
Jul 22 21:55:39.315511 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:39.315483    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:55:39.326313 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:39.326296    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n7rl9_bbc491f2-9c18-4d74-973d-276eca48b2bc/ovn-acl-logging/0.log"
Jul 22 21:55:44.493291 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:44.493250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:44.572118 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:44.572090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log" limit=1024
Jul 22 21:55:47.400512 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:47.400485    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xwpsw_08e931fb-ee7a-4868-af7f-30b6901e8b9c/global-pull-secret-syncer/0.log"
Jul 22 21:55:47.485872 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:47.485853    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-49s67_eb25f2a8-daa1-4402-b583-faf09c6f8e9f/konnectivity-agent/0.log"
Jul 22 21:55:47.632990 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:47.632966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-246.ec2.internal_a841b23908aa8cb00d9d94baa65ea6b1/haproxy/0.log"
Jul 22 21:55:52.004469 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.004440    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/extract/0.log"
Jul 22 21:55:52.030957 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.030930    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/util/0.log"
Jul 22 21:55:52.053455 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.053433    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nftn_bda6ceaf-d86d-4821-bc34-86c03cd51c55/pull/0.log"
Jul 22 21:55:52.788829 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.788800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2mxg6_6c7f2362-8730-427e-893c-9b5b20247054/manager/0.log"
Jul 22 21:55:52.819044 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.819023    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f6mbv_d83ce69c-321b-4c83-9c3f-c87e626b4a5a/manager/0.log"
Jul 22 21:55:52.897608 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:52.897582    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9lj9s_a65fd718-0087-4668-9dca-b87565712c56/registry-server/0.log"
Jul 22 21:55:53.019102 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:53.019074    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zvp77_9d5e2972-f766-4e2e-8a2d-f6d2fbf2b8e7/manager/0.log"
Jul 22 21:55:55.505262 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:55.505234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvn5_5eaddce2-e9fb-468e-916e-895583a9f2ac/node-exporter/0.log"
Jul 22 21:55:55.527852 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:55.527826    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvn5_5eaddce2-e9fb-468e-916e-895583a9f2ac/kube-rbac-proxy/0.log"
Jul 22 21:55:55.550963 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:55.550941    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zrvn5_5eaddce2-e9fb-468e-916e-895583a9f2ac/init-textfile/0.log"
Jul 22 21:55:57.011085 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011049    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"]
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011396    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011408    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011426    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178377b6-91ce-4659-a279-3a798909ea2b" containerName="revoke-keys"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011431    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="178377b6-91ce-4659-a279-3a798909ea2b" containerName="revoke-keys"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011438    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011443    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011450    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011455    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011509    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy"
Jul 22 21:55:57.011517 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011517    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011859 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011524    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="178377b6-91ce-4659-a279-3a798909ea2b" containerName="revoke-keys"
Jul 22 21:55:57.011859 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011531    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f09914b-91f0-432e-b716-0c0df267d63a" containerName="istio-proxy"
Jul 22 21:55:57.011859 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.011538    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec20c5f-4a49-4c2c-91f1-ff200d37e802" containerName="istio-proxy"
Jul 22 21:55:57.014396 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.014380    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.017181 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.017153    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9zx\"/\"kube-root-ca.crt\""
Jul 22 21:55:57.017308 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.017237    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9zx\"/\"openshift-service-ca.crt\""
Jul 22 21:55:57.018115 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.018100    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sw9zx\"/\"default-dockercfg-pcvcv\""
Jul 22 21:55:57.021663 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.021639    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"]
Jul 22 21:55:57.116616 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.116583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8r4j\" (UniqueName: \"kubernetes.io/projected/4cdf131b-00d8-4460-9dde-880766e5db1e-kube-api-access-q8r4j\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.116785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.116631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-sys\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.116785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.116694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-lib-modules\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.116785 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.116712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-podres\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.116929 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.116790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-proc\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.217901 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.217861    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8r4j\" (UniqueName: \"kubernetes.io/projected/4cdf131b-00d8-4460-9dde-880766e5db1e-kube-api-access-q8r4j\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.217917    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-sys\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.217969    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-lib-modules\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218074 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.217992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-podres\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.218069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-sys\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.218124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-proc\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.218150    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-lib-modules\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.218157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-podres\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.218256 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.218239    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cdf131b-00d8-4460-9dde-880766e5db1e-proc\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.227182 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.227155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8r4j\" (UniqueName: \"kubernetes.io/projected/4cdf131b-00d8-4460-9dde-880766e5db1e-kube-api-access-q8r4j\") pod \"perf-node-gather-daemonset-6fqzf\" (UID: \"4cdf131b-00d8-4460-9dde-880766e5db1e\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.324664 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.324588    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.456408 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.456301    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"]
Jul 22 21:55:57.460410 ip-10-0-142-246 kubenswrapper[2569]: W0722 21:55:57.460374    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cdf131b_00d8_4460_9dde_880766e5db1e.slice/crio-ccdacc30ebd10594e007d461c437b21003e8ec6db915d0c9c5e3424ec1e6f9ab WatchSource:0}: Error finding container ccdacc30ebd10594e007d461c437b21003e8ec6db915d0c9c5e3424ec1e6f9ab: Status 404 returned error can't find the container with id ccdacc30ebd10594e007d461c437b21003e8ec6db915d0c9c5e3424ec1e6f9ab
Jul 22 21:55:57.737180 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.737122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf" event={"ID":"4cdf131b-00d8-4460-9dde-880766e5db1e","Type":"ContainerStarted","Data":"60a7d2204eccb126dbf981d36a82be190b96ce7f85d76a76f1f70a7d0d7f8b7b"}
Jul 22 21:55:57.737339 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.737200    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf" event={"ID":"4cdf131b-00d8-4460-9dde-880766e5db1e","Type":"ContainerStarted","Data":"ccdacc30ebd10594e007d461c437b21003e8ec6db915d0c9c5e3424ec1e6f9ab"}
Jul 22 21:55:57.737339 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.737231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:55:57.756260 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:57.756215    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf" podStartSLOduration=1.756200634 podStartE2EDuration="1.756200634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:55:57.754314314 +0000 UTC m=+3019.091929195" watchObservedRunningTime="2026-07-22 21:55:57.756200634 +0000 UTC m=+3019.093815512"
Jul 22 21:55:58.367592 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:55:58.367562    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-b7smb_e85294ab-9314-41b2-9f2a-de23aabf60f8/download-server/0.log"
Jul 22 21:56:00.101174 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:00.101118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j7wnh_1da27dcc-5799-4f36-9bd3-614d7b4377d2/dns/0.log"
Jul 22 21:56:00.121733 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:00.121704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j7wnh_1da27dcc-5799-4f36-9bd3-614d7b4377d2/kube-rbac-proxy/0.log"
Jul 22 21:56:00.167596 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:00.167570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w76cl_ea6ceeb0-3728-40fa-a2ac-3e584cf079b8/dns-node-resolver/0.log"
Jul 22 21:56:00.720682 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:00.720651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5744b9cc-s6n48_e15afd7b-c744-41ea-ae94-2b50037e0488/registry/0.log"
Jul 22 21:56:00.773375 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:00.773342    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjb5g_4fe7ad62-5387-4b4c-a773-a9144974a8a0/node-ca/0.log"
Jul 22 21:56:01.848404 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:01.848367    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w77kh_dce60bb0-8b90-4da0-8c15-3e438d2fd574/discovery/0.log"
Jul 22 21:56:01.871920 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:01.871893    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-bl4zn_595d0fae-89d4-475a-a136-f5af667d9aa3/kube-auth-proxy/0.log"
Jul 22 21:56:02.050065 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:02.050038    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p2f96_d0adb0dc-70b6-4cae-b882-be3c57576650/payload-processing/0.log"
Jul 22 21:56:02.736624 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:02.736596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27q68_ad02ba68-aa15-4b89-8dbf-8b0e4d7cc1ed/serve-healthcheck-canary/0.log"
Jul 22 21:56:03.303771 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:03.303744    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-94qnv_36242283-0c7a-496f-946b-f9b0d798a2af/kube-rbac-proxy/0.log"
Jul 22 21:56:03.324935 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:03.324914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-94qnv_36242283-0c7a-496f-946b-f9b0d798a2af/exporter/0.log"
Jul 22 21:56:03.345693 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:03.345671    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-94qnv_36242283-0c7a-496f-946b-f9b0d798a2af/extractor/0.log"
Jul 22 21:56:03.751902 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:03.751876    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-6fqzf"
Jul 22 21:56:05.821447 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:05.821418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4pdhk_ffc53625-d872-472c-8630-73d114818d8a/manager/0.log"
Jul 22 21:56:06.331162 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:06.331118    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wm56c_f14b3603-e793-4ce0-9cf7-11a64262d044/server/0.log"
Jul 22 21:56:06.413821 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:06.413791    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fd7gz_f475fbcc-8b3a-4394-9e7e-1faf9e6c3414/manager/0.log"
Jul 22 21:56:06.577697 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:06.577657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-55m2h_31077411-67b0-4bcb-a206-dac4a35ba902/manager/0.log"
Jul 22 21:56:06.596769 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:06.596685    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-55m2h_31077411-67b0-4bcb-a206-dac4a35ba902/copy-manifests/0.log"
Jul 22 21:56:07.808149 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:07.808103    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w77kh_dce60bb0-8b90-4da0-8c15-3e438d2fd574/discovery/0.log"
Jul 22 21:56:07.831526 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:07.831495    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-bl4zn_595d0fae-89d4-475a-a136-f5af667d9aa3/kube-auth-proxy/0.log"
Jul 22 21:56:07.962712 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:07.962679    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p2f96_d0adb0dc-70b6-4cae-b882-be3c57576650/payload-processing/0.log"
Jul 22 21:56:09.457728 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:09.457680    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w77kh_dce60bb0-8b90-4da0-8c15-3e438d2fd574/discovery/0.log"
Jul 22 21:56:09.469221 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:09.469189    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-bl4zn_595d0fae-89d4-475a-a136-f5af667d9aa3/kube-auth-proxy/0.log"
Jul 22 21:56:09.605636 ip-10-0-142-246 kubenswrapper[2569]: I0722 21:56:09.605607    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p2f96_d0adb0dc-70b6-4cae-b882-be3c57576650/payload-processing/0.log"