Jul 30 20:23:05.684123 ip-10-0-139-183 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 20:23:05.684137 ip-10-0-139-183 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 20:23:05.684147 ip-10-0-139-183 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 20:23:05.684471 ip-10-0-139-183 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 20:23:15.693815 ip-10-0-139-183 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 20:23:15.693834 ip-10-0-139-183 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f39010ffb57040168b2ee50a754078c3 --
Jul 30 20:25:12.640107 ip-10-0-139-183 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 20:25:13.015589 ip-10-0-139-183 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:25:13.015589 ip-10-0-139-183 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 20:25:13.015589 ip-10-0-139-183 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:25:13.015589 ip-10-0-139-183 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 20:25:13.015589 ip-10-0-139-183 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:25:13.017364 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.017270    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 20:25:13.021764 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021746    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.021764 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021764    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.021764 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021769    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021775    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021794    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021799    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021803    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021806    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021810    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021814    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021818    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021822    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021826    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021830    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021834    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021839    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021843    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021847    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021851    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021855    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021859    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021871    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.021958 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021876    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021880    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021885    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021889    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021893    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021898    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021902    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021907    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021911    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021916    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021920    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021925    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021929    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021934    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021938    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021943    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021947    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021951    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021955    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021959    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.022795 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021963    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021967    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021972    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021976    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021980    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021984    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021988    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021992    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.021997    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022001    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022005    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022010    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022015    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022019    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022023    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022027    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022032    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022036    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022040    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022045    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.023622 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022049    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022053    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022058    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022063    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022067    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022071    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022076    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022082    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022087    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022092    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022096    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022100    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022105    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022109    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022116    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022122    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022127    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022131    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022136    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.024449 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022141    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022147    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022153    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022158    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022162    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022166    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022171    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022176    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022180    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022184    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022188    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022192    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022197    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022201    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022207    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022212    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022216    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.022220    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023331    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.025045 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023341    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023346    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023350    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023355    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023360    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023364    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023368    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023373    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023378    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023382    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023386    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023391    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023396    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023401    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023405    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023410    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023414    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023418    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023423    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023426    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.025531 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023432    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023437    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023441    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023445    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023449    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023454    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023458    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023462    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023466    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023471    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023475    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023480    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023485    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023489    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023493    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023498    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023502    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023506    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023511    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.026040 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023518    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023524    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023529    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023533    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023538    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023542    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023546    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023551    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023555    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023561    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023566    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023570    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023574    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023578    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023583    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023588    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023592    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023596    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023600    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023605    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.026484 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023610    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023614    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023618    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023622    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023627    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023631    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023635    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023639    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023643    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023647    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023654    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023660    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023665    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023669    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023674    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023682    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023686    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023690    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023695    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023699    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.026987 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023703    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023707    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023712    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023716    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023720    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023724    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023728    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023734    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023738    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023743    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023747    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023751    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023755    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023760    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023764    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023769    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023773    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023792    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.023797    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025616    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.027487 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025626    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025629    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025633    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025636    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025639    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025642    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025644    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025647    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025649    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025652    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025655    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025657    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025660    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025662    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025665    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025667    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025670    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025673    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025675    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025683    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.027967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025685    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025688    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025691    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025693    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025696    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025699    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025701    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025704    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025706    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025709    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025711    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025713    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025717    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025719    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025722    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025725    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025727    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025730    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025733    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025735    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.028446 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025738    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025741    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025744    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025747    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025749    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025752    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025754    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025757    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025759    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025764    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025768    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025772    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025775    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025791    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025794    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025797    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025799    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025802    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025805    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.028967 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025808    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025811    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025813    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025816    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025819    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025821    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025824    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025827    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025829    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025832    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025834    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025837    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025841    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025844    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025847    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025850    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025853    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025856    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025859    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.029415 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025861    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025864    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025866    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025868    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025871    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025874    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025876    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025879    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025881    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025884    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025886    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025890    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025892    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025894    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025897    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025899    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025902    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025905    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025908    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.025910    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025975    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 20:25:13.029919 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025982    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025987    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025991    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025995    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.025998    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026002    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026005    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026008    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026011    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026014    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026017    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026020    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026023    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026025    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026028    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026031    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026035    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026039    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026042    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026045    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026048    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026051    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026055    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 20:25:13.030435 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026058    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026061    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026067    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026070    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026073    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026075    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026078    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026081    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026085    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026088    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026091    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026093    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026096    2560 flags.go:64] FLAG: --enable-server="true"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026099    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026103    2560 flags.go:64] FLAG: --event-burst="100"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026105    2560 flags.go:64] FLAG: --event-qps="50"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026108    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026111    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026114    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026117    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026120    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026123    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026126    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026129    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026132    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 20:25:13.031001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026135    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026138    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026141    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026143    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026146    2560 flags.go:64] FLAG: --feature-gates=""
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026150    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026152    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026155    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026158    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026162    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026165    2560 flags.go:64] FLAG: --help="false"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026168    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026171    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026173    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026176    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026179    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026183    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026185    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026188    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026191    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026193    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026196    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026199    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026202    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 30 20:25:13.031606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026205    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026207    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026210    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026213    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026216    2560 flags.go:64] FLAG: --lock-file=""
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026218    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026221    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026224    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026229    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026232    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026235    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026238    2560 flags.go:64] FLAG: --logging-format="text"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026240    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026243    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026247    2560 flags.go:64] FLAG: --manifest-url=""
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026249    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026254    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026258    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026262    2560 flags.go:64] FLAG: --max-pods="110"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026264    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026267    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026270    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026273    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026276    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026279    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 20:25:13.032242 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026282    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026288    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026291    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026294    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026296    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026299    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026305    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026307    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026310    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026313    2560 flags.go:64] FLAG: --port="10250"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026316    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026319    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e8ebd0241831e692"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026322    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026325    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026327    2560 flags.go:64] FLAG: --register-node="true"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026330    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026334    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026336    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026339    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026342    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026345    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026348    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026351    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026354    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026356    2560 flags.go:64] FLAG: --runonce="false"
Jul 30 20:25:13.032850 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026360    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026363    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026366    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026369    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026371    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026374    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026377    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026380    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026383    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026385    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026388    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026391    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026393    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026396    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026399    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026404    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026407    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026410    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026414    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026416    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026419    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026422    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026424    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026427    2560 flags.go:64] FLAG: --v="2"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026430    2560 flags.go:64] FLAG: --version="false"
Jul 30 20:25:13.033476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026434    2560 flags.go:64] FLAG: --vmodule=""
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026437    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.026440    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026540    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026543    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026546    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026549    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026552    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026554    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026557    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026559    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026562    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026564    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026566    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026569    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026572    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026574    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026576    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026579    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026581    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.034081 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026584    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026586    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026589    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026591    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026595    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026597    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026600    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026602    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026605    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026608    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026610    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026612    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026615    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026617    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026620    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026622    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026625    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026628    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026630    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026633    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.034546 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026635    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026638    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026640    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026643    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026645    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026647    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026650    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026652    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026655    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026657    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026660    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026664    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026667    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026671    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026673    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026677    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026682    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026685    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026688    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.035035 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026690    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026693    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026696    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026699    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026701    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026704    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026707    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026710    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026713    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026715    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026717    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026720    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026722    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026725    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026727    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026730    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026732    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026735    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026737    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.035499 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026739    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026742    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026744    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026747    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026749    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026751    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026754    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026756    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026759    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026761    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026764    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026767    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026769    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026771    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026774    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026776    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026793    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026795    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026798    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.036038 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026801    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026803    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026805    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026808    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.026811    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.027411    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.033521    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.033534    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.034258    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.034265    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034317    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034322    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034325    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034328    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.036488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034331    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034333    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034336    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034338    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034341    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034343    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034346    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034349    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034351    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034354    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034356    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034359    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034361    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034363    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034366    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034368    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034371    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034373    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034376    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034378    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.036837 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034381    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034383    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034385    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034388    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034390    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034394    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034397    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034401    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034404    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034407    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034410    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034413    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034415    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034418    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034420    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034423    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034425    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034427    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034430    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034432    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.037312 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034435    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034437    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034440    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034442    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034444    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034447    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034450    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034452    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034454    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034457    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034460    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034462    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034465    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034467    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034470    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034472    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034475    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034478    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034481    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.037796 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034485    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034488    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034490    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034493    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034496    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034500    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034503    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034505    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034508    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034510    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034512    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034515    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034517    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034520    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034522    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034524    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034527    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034529    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034532    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034534    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.038240 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034536    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034539    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034541    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034544    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034547    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034550    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034553    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034555    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034558    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034561    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034563    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034566    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034569    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034572    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034574    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.038717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034577    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.034581    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034679    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034684    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034686    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034689    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034691    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034694    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034697    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034699    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034702    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034705    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034707    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034710    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034713    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:25:13.039078 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034715    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034718    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034720    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034722    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034725    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034728    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034730    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034733    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034735    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034738    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034740    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034742    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034745    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034747    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034750    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034753    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034755    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034757    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034760    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034762    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:25:13.039439 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034765    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034767    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034770    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034772    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034774    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034791    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034794    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034797    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034799    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034802    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034804    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034807    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034809    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034812    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034814    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034817    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034820    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034822    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034824    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034827    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034829    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:25:13.039906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034832    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034834    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034836    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034840    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034844    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034848    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034851    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034855    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034857    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034860    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034862    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034864    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034867    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034869    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034872    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034874    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034878    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034881    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:25:13.040387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034883    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034886    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034889    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034891    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034894    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034896    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034899    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034901    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034904    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034906    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034909    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034911    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034913    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034916    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034918    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034920    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034923    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034925    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034928    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034931    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:25:13.040924 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034933    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034935    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034938    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034941    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034943    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034945    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:13.034948    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.034952    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.035049    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.036951    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.038244    2560 server.go:1019] "Starting client certificate rotation"
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.038339    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.038383    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:25:13.041387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.040530    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:25:13.044225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.044209    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:25:13.054451 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.054434    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 30 20:25:13.057333 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.057316    2560 log.go:25] "Validated CRI v1 image API"
Jul 30 20:25:13.058144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.058131    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 20:25:13.060235 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.060218    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91b56de0-c1bd-4bd9-bdaa-f196cd494e24:/dev/nvme0n1p3 be2e7bb6-870c-41d1-8d7c-d3503f68a301:/dev/nvme0n1p4]
Jul 30 20:25:13.060292 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.060234    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 20:25:13.065859 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.065737    2560 manager.go:216] Machine: {Timestamp:2026-07-30 20:25:13.064650009 +0000 UTC m=+0.318990268 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3170033 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec295101148721aae04f1fd05fccff6c SystemUUID:ec295101-1487-21aa-e04f-1fd05fccff6c BootID:f39010ff-b570-4016-8b2e-e50a754078c3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:a0:1f:2a:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:a0:1f:2a:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:14:09:50:f1:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 20:25:13.065859 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.065856    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 20:25:13.065970 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.065928    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 20:25:13.066885 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.066864    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 20:25:13.066996 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.066886    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 20:25:13.067539 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.067530    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 20:25:13.067572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.067542    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 20:25:13.067572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.067549    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:25:13.068283 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.068272    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:25:13.068406 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.068391    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:25:13.069109 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.069099    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 20:25:13.072346 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072334    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:25:13.072456 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072447    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 20:25:13.072490 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072476    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 20:25:13.072490 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072487    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 20:25:13.072539 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072499    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 20:25:13.072539 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072506    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 30 20:25:13.072539 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072517    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 20:25:13.072826 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072814    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:25:13.072875 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.072831    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:25:13.074983 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.074968    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 20:25:13.076318 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.076305    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 20:25:13.076356 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.076333    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 20:25:13.077451 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077433    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 20:25:13.077451 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077454    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077463    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077472    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077483    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077491    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077502    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077509    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077518    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077526    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077553    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 20:25:13.077604 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.077561    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 20:25:13.078434 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.078423    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 20:25:13.078487 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.078437    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 20:25:13.081362 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.081346    2560 server.go:1268] "Started kubelet"
Jul 30 20:25:13.081454 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.081416    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 20:25:13.081511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.081431    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 20:25:13.081511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.081494    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 20:25:13.082128 ip-10-0-139-183 systemd[1]: Started Kubernetes Kubelet.
Jul 30 20:25:13.082504 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.082486    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 20:25:13.083309 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.083273    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 20:25:13.083377 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.083343    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 20:25:13.083377 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.083347    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 20:25:13.086376 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.086356    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 20:25:13.088400 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.088376    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 20:25:13.089634 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.089616    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 20:25:13.089634 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.089627    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 20:25:13.089790 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.088697    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-183.ec2.internal.18c72b0d39e12692  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-183.ec2.internal,UID:ip-10-0-139-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-183.ec2.internal,},FirstTimestamp:2026-07-30 20:25:13.08131701 +0000 UTC m=+0.335657270,LastTimestamp:2026-07-30 20:25:13.08131701 +0000 UTC m=+0.335657270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-183.ec2.internal,}"
Jul 30 20:25:13.089790 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.089697    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.090330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090311    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 20:25:13.090330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090311    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 20:25:13.090424 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090340    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 20:25:13.090460 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090446    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 20:25:13.090460 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090455    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 20:25:13.090533 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090510    2560 factory.go:55] Registering systemd factory
Jul 30 20:25:13.090533 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090524    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 30 20:25:13.090759 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090746    2560 factory.go:153] Registering CRI-O factory
Jul 30 20:25:13.090759 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090759    2560 factory.go:223] Registration of the crio container factory successfully
Jul 30 20:25:13.090879 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090816    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 20:25:13.090879 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090835    2560 factory.go:103] Registering Raw factory
Jul 30 20:25:13.090879 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.090847    2560 manager.go:1196] Started watching for new ooms in manager
Jul 30 20:25:13.091229 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.091211    2560 manager.go:349] Starting recovery of all containers
Jul 30 20:25:13.094243 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.094219    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qh2rr"
Jul 30 20:25:13.097103 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.097073    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 20:25:13.097182 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.097145    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 20:25:13.100223 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.100204    2560 manager.go:354] Recovery completed
Jul 30 20:25:13.100567 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.100553    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qh2rr"
Jul 30 20:25:13.105087 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.104977    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.114149 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114133    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.114224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114162    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.114224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.114625 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114613    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 20:25:13.114625 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114625    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 20:25:13.114734 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114629    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.114734 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.114641    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:25:13.115342 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115330    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.115399 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115352    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.115399 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115360    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.115708 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115696    2560 policy_none.go:49] "None policy: Start"
Jul 30 20:25:13.115760 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115715    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 20:25:13.115760 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.115728    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 20:25:13.116444 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.116204    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-183.ec2.internal.18c72b0d3bd61aab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-183.ec2.internal,UID:ip-10-0-139-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-183.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-183.ec2.internal,},FirstTimestamp:2026-07-30 20:25:13.114147499 +0000 UTC m=+0.368487766,LastTimestamp:2026-07-30 20:25:13.114147499 +0000 UTC m=+0.368487766,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-183.ec2.internal,}"
Jul 30 20:25:13.116966 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.116952    2560 policy_none.go:47] "Start"
Jul 30 20:25:13.152420 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152304    2560 manager.go:337] "Starting Device Plugin manager"
Jul 30 20:25:13.152503 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.152443    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 20:25:13.152503 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152457    2560 server.go:87] "Starting device plugin registration server"
Jul 30 20:25:13.152709 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152697    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 20:25:13.152743 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152713    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 20:25:13.152867 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152850    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 20:25:13.152976 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152931    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 20:25:13.152976 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.152942    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 20:25:13.153326 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.153309    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 20:25:13.153404 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.153347    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.249311 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.249285    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 20:25:13.250388 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.250337    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 20:25:13.250388 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.250367    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 20:25:13.250388 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.250383    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 20:25:13.250549 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.250409    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 20:25:13.252228 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.252209    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:25:13.252830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.252818    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.253880 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.253858    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.253944 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.253890    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.253944 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.253901    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.253944 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.253918    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.261487 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.261472    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.261570 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.261494    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-183.ec2.internal\": node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.274598 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.274553    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.350640 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.350606    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"]
Jul 30 20:25:13.350717 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.350671    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.351926 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.351913    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.351984 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.351935    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.351984 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.351944    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.353002 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.352989    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.353121 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.353177 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353140    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.353587 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353573    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.353685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353598    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.353685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353576    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.353685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353612    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.353685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353620    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.353685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.353630    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.354845 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.354830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.354904 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.354852    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:25:13.355485 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.355470    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:25:13.355581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.355496    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:25:13.355581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.355508    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:25:13.375560 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.375542    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.380456 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.380442    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-183.ec2.internal\" not found" node="ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.385090 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.385075    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-183.ec2.internal\" not found" node="ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.392685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.392669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.392758 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.392693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.392758 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.392709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0a2f4ccd5d2e85c9491226551504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-183.ec2.internal\" (UID: \"5d0a2f4ccd5d2e85c9491226551504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.476642 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.476622    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.493832 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.493812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.493935 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.493872    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.493935 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.493912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.493935 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.493915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a893bb6aa30c278ea1ece7dfa71d8ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal\" (UID: \"0a893bb6aa30c278ea1ece7dfa71d8ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.494081 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.493957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0a2f4ccd5d2e85c9491226551504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-183.ec2.internal\" (UID: \"5d0a2f4ccd5d2e85c9491226551504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.494081 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.494005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0a2f4ccd5d2e85c9491226551504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-183.ec2.internal\" (UID: \"5d0a2f4ccd5d2e85c9491226551504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.577560 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.577515    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.681591 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.681564    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.683893 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.683880    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.688060 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:13.688047    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:13.784449 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.784423    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.885045 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.884996    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:13.986185 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:13.986163    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:14.037459 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.037434    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 20:25:14.037843 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.037583    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 20:25:14.086904 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:14.086888    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:14.104886 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.104848    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 20:20:13 +0000 UTC" deadline="2028-04-08 18:54:01.456054864 +0000 UTC"
Jul 30 20:25:14.104886 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.104886    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14830h28m47.351172757s"
Jul 30 20:25:14.182463 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:14.182435    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0a2f4ccd5d2e85c9491226551504c3.slice/crio-a41ec076cb8526ffde0746c4f6d3723f4b00a67b0024cf8dac81445b3c253cb9 WatchSource:0}: Error finding container a41ec076cb8526ffde0746c4f6d3723f4b00a67b0024cf8dac81445b3c253cb9: Status 404 returned error can't find the container with id a41ec076cb8526ffde0746c4f6d3723f4b00a67b0024cf8dac81445b3c253cb9
Jul 30 20:25:14.182717 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:14.182687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a893bb6aa30c278ea1ece7dfa71d8ce.slice/crio-808244b01ff6160379d6445d9ce3090243fc76722f61f769a0fc4efd6d3fa480 WatchSource:0}: Error finding container 808244b01ff6160379d6445d9ce3090243fc76722f61f769a0fc4efd6d3fa480: Status 404 returned error can't find the container with id 808244b01ff6160379d6445d9ce3090243fc76722f61f769a0fc4efd6d3fa480
Jul 30 20:25:14.187144 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:14.187065    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:14.189193 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.189171    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:25:14.237793 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.237760    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:25:14.253666 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.253626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal" event={"ID":"5d0a2f4ccd5d2e85c9491226551504c3","Type":"ContainerStarted","Data":"a41ec076cb8526ffde0746c4f6d3723f4b00a67b0024cf8dac81445b3c253cb9"}
Jul 30 20:25:14.254635 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.254615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal" event={"ID":"0a893bb6aa30c278ea1ece7dfa71d8ce","Type":"ContainerStarted","Data":"808244b01ff6160379d6445d9ce3090243fc76722f61f769a0fc4efd6d3fa480"}
Jul 30 20:25:14.287236 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:14.287199    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:14.387722 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:14.387696    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-183.ec2.internal\" not found"
Jul 30 20:25:14.483798 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.483741    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:25:14.490044 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.490023    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:14.500446 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.500429    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:25:14.502436 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.502423    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal"
Jul 30 20:25:14.512920 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.512904    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:25:14.615832 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:14.614514    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:25:15.073448 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.073419    2560 apiserver.go:52] "Watching apiserver"
Jul 30 20:25:15.082137 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.082114    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 20:25:15.082556 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.082525    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-sz57t","kube-system/konnectivity-agent-rnl78","kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal","openshift-multus/multus-2v8xr","openshift-multus/multus-additional-cni-plugins-6hqxj","openshift-network-operator/iptables-alerter-hgkb4","openshift-ovn-kubernetes/ovnkube-node-cw7l7","kube-system/global-pull-secret-syncer-jhdj9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn","openshift-cluster-node-tuning-operator/tuned-57hk4","openshift-dns/node-resolver-l8zvc","openshift-image-registry/node-ca-q7g6v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal","openshift-multus/network-metrics-daemon-txtsm"]
Jul 30 20:25:15.084161 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.084138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.085375 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.085349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.086707 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.086686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.086797 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.086760    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:15.086880 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.086816    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.087087 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.087067    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 20:25:15.087330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.087307    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 20:25:15.087965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.087944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.088360 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.088342    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 20:25:15.088610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.088588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wnzl9\""
Jul 30 20:25:15.088706 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.088613    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 20:25:15.088706 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.088658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.088897 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.088744    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.089601 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.089581    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.089691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.089637    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.089955 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.089937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nqhdg\""
Jul 30 20:25:15.090349 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 20:25:15.090429 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090334    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.090940 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090516    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 20:25:15.090940 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090579    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 20:25:15.090940 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090612    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.090940 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jglz7\""
Jul 30 20:25:15.091152 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.090980    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.091968 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.091723    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 20:25:15.091968 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.091867    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 20:25:15.092255 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.092238    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4kff\""
Jul 30 20:25:15.092330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.092304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.094150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.093692    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 20:25:15.094226 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094164    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x8kxw\""
Jul 30 20:25:15.094226 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094189    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.094336 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.094609 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094592    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 20:25:15.094712 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094659    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.094786 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094716    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bhccz\""
Jul 30 20:25:15.094874 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.094831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.095172 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.095154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.095253 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.095216    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:15.096847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.096819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.100797 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.100779    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.101283 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.101255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:15.102295 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.102250    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:15.103621 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.103602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.104138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104243 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-os-release\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104243 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-bin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104243 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-etc-kubernetes\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104243 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-netns\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-ovn\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-log-socket\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-conf-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-bin\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovn-node-metrics-cert\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-cnibin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-kubelet\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-cnibin\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.104511 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-systemd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c488b145-121d-43e5-8b89-390ec20c90a9-hosts-file\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-k8s-cni-cncf-io\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-netns\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-multus-certs\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-system-cni-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-os-release\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-multus-daemon-config\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.104974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105002    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v49dv\" (UniqueName: \"kubernetes.io/projected/04324dca-7997-4d87-8c7f-118d186a76ce-kube-api-access-v49dv\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-host-slash\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-slash\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-var-lib-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-netd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c488b145-121d-43e5-8b89-390ec20c90a9-tmp-dir\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-socket-dir-parent\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-iptables-alerter-script\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qtth\" (UniqueName: \"kubernetes.io/projected/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-kube-api-access-4qtth\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-config\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-script-lib\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv677\" (UniqueName: \"kubernetes.io/projected/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-kube-api-access-sv677\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbckp\" (UniqueName: \"kubernetes.io/projected/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-kube-api-access-dbckp\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-system-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-multus\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqtd\" (UniqueName: \"kubernetes.io/projected/7580ea94-a225-4dee-84bc-6cf34a513593-kube-api-access-4mqtd\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-kubelet\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-node-log\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.105965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhwk\" (UniqueName: \"kubernetes.io/projected/c488b145-121d-43e5-8b89-390ec20c90a9-kube-api-access-cmhwk\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.106780 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-cni-binary-copy\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.106780 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-hostroot\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.106780 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-systemd-units\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.106780 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-etc-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.106780 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.105722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-env-overrides\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.107544 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.107431    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7pkgc\""
Jul 30 20:25:15.107544 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.107451    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 20:25:15.107800 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.107766    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 20:25:15.108965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.108695    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.108965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.108747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 20:25:15.108965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.108958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:25:15.109157 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.109040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5qfsx\""
Jul 30 20:25:15.109157 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.109142    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.109722 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.108958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 20:25:15.109722 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.109269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qpn86\""
Jul 30 20:25:15.109722 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.109545    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:25:15.155479 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.155458    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7rk7l"
Jul 30 20:25:15.163683 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.163666    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7rk7l"
Jul 30 20:25:15.191854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.191747    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 20:25:15.205997 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.205968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-modprobe-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.206112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-cnibin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.206112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-kubelet\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.206112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-cnibin\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-kubelet\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206139    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-cnibin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-cnibin\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-systemd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-run\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-systemd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206294    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c488b145-121d-43e5-8b89-390ec20c90a9-hosts-file\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.206359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-var-lib-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysconfig\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v49dv\" (UniqueName: \"kubernetes.io/projected/04324dca-7997-4d87-8c7f-118d186a76ce-kube-api-access-v49dv\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-host-slash\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-var-lib-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-host-slash\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c488b145-121d-43e5-8b89-390ec20c90a9-hosts-file\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv677\" (UniqueName: \"kubernetes.io/projected/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-kube-api-access-sv677\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-kubelet-config\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-systemd\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9faef632-53f0-40ef-9668-5826ad553b50-host\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-registration-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c488b145-121d-43e5-8b89-390ec20c90a9-tmp-dir\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-iptables-alerter-script\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-host\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.206830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skch9\" (UniqueName: \"kubernetes.io/projected/833c5003-b29e-4091-be5c-eff60c28dfd5-kube-api-access-skch9\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hdm2\" (UniqueName: \"kubernetes.io/projected/a792d61d-3ae1-4e52-b682-777cabcd8045-kube-api-access-6hdm2\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbckp\" (UniqueName: \"kubernetes.io/projected/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-kube-api-access-dbckp\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-multus\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqtd\" (UniqueName: \"kubernetes.io/projected/7580ea94-a225-4dee-84bc-6cf34a513593-kube-api-access-4mqtd\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.206997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhwk\" (UniqueName: \"kubernetes.io/projected/c488b145-121d-43e5-8b89-390ec20c90a9-kube-api-access-cmhwk\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-env-overrides\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-tmp\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-device-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-os-release\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-bin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-etc-kubernetes\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c488b145-121d-43e5-8b89-390ec20c90a9-tmp-dir\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-netns\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.207605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-multus\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-var-lib-cni-bin\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-netns\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-etc-kubernetes\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-ovn\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-conf-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-bin\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovn-node-metrics-cert\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.207493    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-iptables-alerter-script\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-conf-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207711    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-ovn\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207893    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.207906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-bin\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.208443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-env-overrides\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-agent-certs\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-kubernetes\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-os-release\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.208392    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:15.708356698 +0000 UTC m=+2.962696958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-conf\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-sys-fs\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-k8s-cni-cncf-io\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-k8s-cni-cncf-io\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-netns\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-multus-certs\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-netns\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-system-cni-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209244 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-host-run-multus-certs\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-system-cni-dir\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-sys\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-os-release\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-multus-daemon-config\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-slash\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-netd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-var-lib-kubelet\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04324dca-7997-4d87-8c7f-118d186a76ce-os-release\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.208950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-slash\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-cni-netd\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-socket-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-socket-dir-parent\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.209973 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-multus-socket-dir-parent\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qtth\" (UniqueName: \"kubernetes.io/projected/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-kube-api-access-4qtth\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04324dca-7997-4d87-8c7f-118d186a76ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-config\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-script-lib\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-dbus\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-system-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-kubelet\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-node-log\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-lib-modules\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209491    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clbf\" (UniqueName: \"kubernetes.io/projected/9faef632-53f0-40ef-9668-5826ad553b50-kube-api-access-2clbf\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-multus-daemon-config\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-cni-binary-copy\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209508    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-host-kubelet\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-system-cni-dir\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.210884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-run-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-node-log\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-hostroot\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7580ea94-a225-4dee-84bc-6cf34a513593-hostroot\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-systemd-units\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-etc-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-systemd-units\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-konnectivity-ca\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-etc-openvswitch\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9faef632-53f0-40ef-9668-5826ad553b50-serviceca\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-script-lib\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-log-socket\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-tuned\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.209968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-log-socket\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.210325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7580ea94-a225-4dee-84bc-6cf34a513593-cni-binary-copy\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.211653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.210338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovnkube-config\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.212553 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.212532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-ovn-node-metrics-cert\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.215466 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.215352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv677\" (UniqueName: \"kubernetes.io/projected/b45d2665-aa5f-4ef0-8dfa-df675acbaa33-kube-api-access-sv677\") pod \"ovnkube-node-cw7l7\" (UID: \"b45d2665-aa5f-4ef0-8dfa-df675acbaa33\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.215466 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.215363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v49dv\" (UniqueName: \"kubernetes.io/projected/04324dca-7997-4d87-8c7f-118d186a76ce-kube-api-access-v49dv\") pod \"multus-additional-cni-plugins-6hqxj\" (UID: \"04324dca-7997-4d87-8c7f-118d186a76ce\") " pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.215823 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.215800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqtd\" (UniqueName: \"kubernetes.io/projected/7580ea94-a225-4dee-84bc-6cf34a513593-kube-api-access-4mqtd\") pod \"multus-2v8xr\" (UID: \"7580ea94-a225-4dee-84bc-6cf34a513593\") " pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.216290 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.216269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbckp\" (UniqueName: \"kubernetes.io/projected/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-kube-api-access-dbckp\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.217034 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.217009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhwk\" (UniqueName: \"kubernetes.io/projected/c488b145-121d-43e5-8b89-390ec20c90a9-kube-api-access-cmhwk\") pod \"node-resolver-l8zvc\" (UID: \"c488b145-121d-43e5-8b89-390ec20c90a9\") " pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.217381 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.217339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qtth\" (UniqueName: \"kubernetes.io/projected/65e1bcd6-05dc-4360-a79b-0ea2f1139daa-kube-api-access-4qtth\") pod \"iptables-alerter-hgkb4\" (UID: \"65e1bcd6-05dc-4360-a79b-0ea2f1139daa\") " pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.261325 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.261304    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:25:15.310860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-kubelet-config\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-systemd\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9faef632-53f0-40ef-9668-5826ad553b50-host\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-registration-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-host\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-systemd\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-kubelet-config\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.310976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skch9\" (UniqueName: \"kubernetes.io/projected/833c5003-b29e-4091-be5c-eff60c28dfd5-kube-api-access-skch9\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-registration-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdm2\" (UniqueName: \"kubernetes.io/projected/a792d61d-3ae1-4e52-b682-777cabcd8045-kube-api-access-6hdm2\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-host\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-tmp\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-device-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9faef632-53f0-40ef-9668-5826ad553b50-host\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-agent-certs\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-kubernetes\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-conf\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-sys-fs\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-kubernetes\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-sys\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-var-lib-kubelet\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysctl-conf\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-socket-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-dbus\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.311667 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.311464    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-lib-modules\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-var-lib-kubelet\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clbf\" (UniqueName: \"kubernetes.io/projected/9faef632-53f0-40ef-9668-5826ad553b50-kube-api-access-2clbf\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-konnectivity-ca\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-sys\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9faef632-53f0-40ef-9668-5826ad553b50-serviceca\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-tuned\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-device-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311681    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-modprobe-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-run\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-socket-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysconfig\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311904    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8f0531f-09e8-4d8d-b67f-669282e39a60-dbus\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.312737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-sys-fs\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.311916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-sysconfig\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-lib-modules\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.312239    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:15.812217522 +0000 UTC m=+3.066557787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-run\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312336    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a792d61d-3ae1-4e52-b682-777cabcd8045-etc-selinux\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9faef632-53f0-40ef-9668-5826ad553b50-serviceca\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-modprobe-d\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.313663 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.312850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-konnectivity-ca\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.314478 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.314099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/99a36f99-8f0f-44f9-84b6-b1c5948a32e4-agent-certs\") pod \"konnectivity-agent-rnl78\" (UID: \"99a36f99-8f0f-44f9-84b6-b1c5948a32e4\") " pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.315056 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.315035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-tmp\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.315608 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.315589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/833c5003-b29e-4091-be5c-eff60c28dfd5-etc-tuned\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.319052 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.319032    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:15.319148 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.319061    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:15.319148 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.319076    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:15.319148 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.319147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:15.819132031 +0000 UTC m=+3.073472305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:15.319658 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.319634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skch9\" (UniqueName: \"kubernetes.io/projected/833c5003-b29e-4091-be5c-eff60c28dfd5-kube-api-access-skch9\") pod \"tuned-57hk4\" (UID: \"833c5003-b29e-4091-be5c-eff60c28dfd5\") " pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.321476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.321453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hdm2\" (UniqueName: \"kubernetes.io/projected/a792d61d-3ae1-4e52-b682-777cabcd8045-kube-api-access-6hdm2\") pod \"aws-ebs-csi-driver-node-p4nnn\" (UID: \"a792d61d-3ae1-4e52-b682-777cabcd8045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.322513 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.322476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clbf\" (UniqueName: \"kubernetes.io/projected/9faef632-53f0-40ef-9668-5826ad553b50-kube-api-access-2clbf\") pod \"node-ca-q7g6v\" (UID: \"9faef632-53f0-40ef-9668-5826ad553b50\") " pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.400177 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.400108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:15.410987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.410961    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8zvc"
Jul 30 20:25:15.419703 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.419682    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2v8xr"
Jul 30 20:25:15.426400 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.426383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6hqxj"
Jul 30 20:25:15.434134 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.434114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgkb4"
Jul 30 20:25:15.441967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.441950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn"
Jul 30 20:25:15.450840 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.450817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:15.458630 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.458612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-57hk4"
Jul 30 20:25:15.465481 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.465464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q7g6v"
Jul 30 20:25:15.715041 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.714961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:15.715206 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.715078    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:15.715206 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.715129    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:16.715115777 +0000 UTC m=+3.969456026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:15.816095 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.816021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:15.816277 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.816237    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:15.816358 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.816305    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:16.81628442 +0000 UTC m=+4.070624729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:15.916672 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:15.916639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:15.916847 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.916774    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:15.916847 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.916789    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:15.916847 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.916799    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:15.916982 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:15.916888    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:16.91686916 +0000 UTC m=+4.171209410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:16.165622 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.165541    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:20:15 +0000 UTC" deadline="2028-04-13 11:30:16.2738403 +0000 UTC"
Jul 30 20:25:16.165622 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.165575    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14943h5m0.108268668s"
Jul 30 20:25:16.201892 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.201863    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e1bcd6_05dc_4360_a79b_0ea2f1139daa.slice/crio-fcb679fc03eb99b5262c9d2a44acbfe03851d16124b81f907a259034ec8ea99f WatchSource:0}: Error finding container fcb679fc03eb99b5262c9d2a44acbfe03851d16124b81f907a259034ec8ea99f: Status 404 returned error can't find the container with id fcb679fc03eb99b5262c9d2a44acbfe03851d16124b81f907a259034ec8ea99f
Jul 30 20:25:16.204769 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.204686    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7580ea94_a225_4dee_84bc_6cf34a513593.slice/crio-fd3d5db85b6691878d867af73ea6270ac18d91eab84afb63c97993e01a2c0d3d WatchSource:0}: Error finding container fd3d5db85b6691878d867af73ea6270ac18d91eab84afb63c97993e01a2c0d3d: Status 404 returned error can't find the container with id fd3d5db85b6691878d867af73ea6270ac18d91eab84afb63c97993e01a2c0d3d
Jul 30 20:25:16.208193 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.208179    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833c5003_b29e_4091_be5c_eff60c28dfd5.slice/crio-8c72cbd393087c44d735d33ad269ae94f10141846a3d58c40a6f9f75b96d3bde WatchSource:0}: Error finding container 8c72cbd393087c44d735d33ad269ae94f10141846a3d58c40a6f9f75b96d3bde: Status 404 returned error can't find the container with id 8c72cbd393087c44d735d33ad269ae94f10141846a3d58c40a6f9f75b96d3bde
Jul 30 20:25:16.209675 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.209648    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda792d61d_3ae1_4e52_b682_777cabcd8045.slice/crio-5c61359dafa38b2bc0b84282c5c9ed669e585e65f341bebb3d1f5a4f137a4f90 WatchSource:0}: Error finding container 5c61359dafa38b2bc0b84282c5c9ed669e585e65f341bebb3d1f5a4f137a4f90: Status 404 returned error can't find the container with id 5c61359dafa38b2bc0b84282c5c9ed669e585e65f341bebb3d1f5a4f137a4f90
Jul 30 20:25:16.210488 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.210467    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9faef632_53f0_40ef_9668_5826ad553b50.slice/crio-01f45379bbb37116290cd1dedcf4beced617d8a770461aa92e14524185d3fc6a WatchSource:0}: Error finding container 01f45379bbb37116290cd1dedcf4beced617d8a770461aa92e14524185d3fc6a: Status 404 returned error can't find the container with id 01f45379bbb37116290cd1dedcf4beced617d8a770461aa92e14524185d3fc6a
Jul 30 20:25:16.211474 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.211447    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc488b145_121d_43e5_8b89_390ec20c90a9.slice/crio-b6486c64dc1b7d7789ac3054be84d48333c4fdced3cd74b0a39a84d006923611 WatchSource:0}: Error finding container b6486c64dc1b7d7789ac3054be84d48333c4fdced3cd74b0a39a84d006923611: Status 404 returned error can't find the container with id b6486c64dc1b7d7789ac3054be84d48333c4fdced3cd74b0a39a84d006923611
Jul 30 20:25:16.212493 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.212455    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45d2665_aa5f_4ef0_8dfa_df675acbaa33.slice/crio-8799ab28878c9966626283e15d4f26b7d1237ebbc2d5d0658fa98777965787d7 WatchSource:0}: Error finding container 8799ab28878c9966626283e15d4f26b7d1237ebbc2d5d0658fa98777965787d7: Status 404 returned error can't find the container with id 8799ab28878c9966626283e15d4f26b7d1237ebbc2d5d0658fa98777965787d7
Jul 30 20:25:16.213906 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.213412    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04324dca_7997_4d87_8c7f_118d186a76ce.slice/crio-e003e789bc20a56642ba1c73fd48ea2f99a9bd44d1c605fabb15c1c65112e75d WatchSource:0}: Error finding container e003e789bc20a56642ba1c73fd48ea2f99a9bd44d1c605fabb15c1c65112e75d: Status 404 returned error can't find the container with id e003e789bc20a56642ba1c73fd48ea2f99a9bd44d1c605fabb15c1c65112e75d
Jul 30 20:25:16.214127 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:16.214077    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a36f99_8f0f_44f9_84b6_b1c5948a32e4.slice/crio-0b5a959538ca4e7949aa43a42d2755ae5de81178ed10f714d07035c68284ab53 WatchSource:0}: Error finding container 0b5a959538ca4e7949aa43a42d2755ae5de81178ed10f714d07035c68284ab53: Status 404 returned error can't find the container with id 0b5a959538ca4e7949aa43a42d2755ae5de81178ed10f714d07035c68284ab53
Jul 30 20:25:16.258770 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.258738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerStarted","Data":"e003e789bc20a56642ba1c73fd48ea2f99a9bd44d1c605fabb15c1c65112e75d"}
Jul 30 20:25:16.262257 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.262233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8zvc" event={"ID":"c488b145-121d-43e5-8b89-390ec20c90a9","Type":"ContainerStarted","Data":"b6486c64dc1b7d7789ac3054be84d48333c4fdced3cd74b0a39a84d006923611"}
Jul 30 20:25:16.268537 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.268507    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn" event={"ID":"a792d61d-3ae1-4e52-b682-777cabcd8045","Type":"ContainerStarted","Data":"5c61359dafa38b2bc0b84282c5c9ed669e585e65f341bebb3d1f5a4f137a4f90"}
Jul 30 20:25:16.269657 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.269631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnl78" event={"ID":"99a36f99-8f0f-44f9-84b6-b1c5948a32e4","Type":"ContainerStarted","Data":"0b5a959538ca4e7949aa43a42d2755ae5de81178ed10f714d07035c68284ab53"}
Jul 30 20:25:16.270759 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.270739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"8799ab28878c9966626283e15d4f26b7d1237ebbc2d5d0658fa98777965787d7"}
Jul 30 20:25:16.271924 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.271882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q7g6v" event={"ID":"9faef632-53f0-40ef-9668-5826ad553b50","Type":"ContainerStarted","Data":"01f45379bbb37116290cd1dedcf4beced617d8a770461aa92e14524185d3fc6a"}
Jul 30 20:25:16.273029 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.273011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57hk4" event={"ID":"833c5003-b29e-4091-be5c-eff60c28dfd5","Type":"ContainerStarted","Data":"8c72cbd393087c44d735d33ad269ae94f10141846a3d58c40a6f9f75b96d3bde"}
Jul 30 20:25:16.274233 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.274201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2v8xr" event={"ID":"7580ea94-a225-4dee-84bc-6cf34a513593","Type":"ContainerStarted","Data":"fd3d5db85b6691878d867af73ea6270ac18d91eab84afb63c97993e01a2c0d3d"}
Jul 30 20:25:16.275415 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.275381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgkb4" event={"ID":"65e1bcd6-05dc-4360-a79b-0ea2f1139daa","Type":"ContainerStarted","Data":"fcb679fc03eb99b5262c9d2a44acbfe03851d16124b81f907a259034ec8ea99f"}
Jul 30 20:25:16.722693 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.721745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:16.722693 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.722205    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:16.722693 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.722264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:18.722250172 +0000 UTC m=+5.976590422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:16.823234 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.823193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:16.823416 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.823391    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:16.823483 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.823460    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:18.823441441 +0000 UTC m=+6.077781694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:16.924425 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:16.924386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:16.924612 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.924600    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:16.924679 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.924619    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:16.924679 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.924633    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:16.924777 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:16.924694    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:18.924675522 +0000 UTC m=+6.179015776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:17.166302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.166196    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:20:15 +0000 UTC" deadline="2028-03-18 01:29:15.536834588 +0000 UTC"
Jul 30 20:25:17.166302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.166255    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14309h3m58.370584389s"
Jul 30 20:25:17.254205 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.254174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:17.254371 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:17.254312    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:17.254441 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.254418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:17.255158 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:17.255118    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:17.255262 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.255210    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:17.255331 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:17.255300    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:17.307862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.307508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal" event={"ID":"5d0a2f4ccd5d2e85c9491226551504c3","Type":"ContainerStarted","Data":"3e540ea8b0b15c1a6b3efdd25e233440a65e0da850ff1c13a45f62694cdfbef9"}
Jul 30 20:25:17.318556 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.318516    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a893bb6aa30c278ea1ece7dfa71d8ce" containerID="69f90e39985986bf188d51bfbc402f2df867ca4bfa9f7a2a0e8d32a883dfd62b" exitCode=0
Jul 30 20:25:17.318657 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.318561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal" event={"ID":"0a893bb6aa30c278ea1ece7dfa71d8ce","Type":"ContainerDied","Data":"69f90e39985986bf188d51bfbc402f2df867ca4bfa9f7a2a0e8d32a883dfd62b"}
Jul 30 20:25:17.342927 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:17.342879    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-183.ec2.internal" podStartSLOduration=3.342845569 podStartE2EDuration="3.342845569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:17.325057655 +0000 UTC m=+4.579397928" watchObservedRunningTime="2026-07-30 20:25:17.342845569 +0000 UTC m=+4.597185832"
Jul 30 20:25:18.340007 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:18.339971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal" event={"ID":"0a893bb6aa30c278ea1ece7dfa71d8ce","Type":"ContainerStarted","Data":"21eabf7c8e80f409b7c31bad01cf2576764955717aa032d6928018f87e373ebe"}
Jul 30 20:25:18.354476 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:18.354419    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-183.ec2.internal" podStartSLOduration=4.354400463 podStartE2EDuration="4.354400463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:18.354330504 +0000 UTC m=+5.608670777" watchObservedRunningTime="2026-07-30 20:25:18.354400463 +0000 UTC m=+5.608740729"
Jul 30 20:25:18.738268 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:18.738186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:18.738435 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.738380    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:18.738511 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.738443    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.738423435 +0000 UTC m=+9.992763697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:18.839555 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:18.839515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:18.839739 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.839722    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:18.839840 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.839803    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.839769962 +0000 UTC m=+10.094110230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:18.940546 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:18.940513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:18.940731 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.940707    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:18.940837 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.940735    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:18.940837 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.940748    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:18.940837 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:18.940819    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:22.94080054 +0000 UTC m=+10.195140796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:19.252594 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:19.251877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:19.252594 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:19.252012    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:19.252594 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:19.252378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:19.252594 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:19.252472    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:19.253189 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:19.252987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:19.253189 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:19.253082    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:21.251737    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:21.251762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:21.251774    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:21.251883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:21.252288    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:21.252410 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:21.252378    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:22.771874 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:22.771831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:22.772314 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.772002    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:22.772314 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.772082    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:30.772061929 +0000 UTC m=+18.026402190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:22.872927 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:22.872890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:22.873100 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.873006    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:22.873100 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.873060    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:30.873043894 +0000 UTC m=+18.127384142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:22.973593 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:22.973560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:22.973768 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.973749    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:22.973879 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.973769    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:22.973879 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.973797    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:22.973879 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:22.973852    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:30.973835583 +0000 UTC m=+18.228175845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:23.251581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:23.251511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:23.251730 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:23.251619    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:23.251903 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:23.251875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:23.252042 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:23.252017    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:23.252109 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:23.252047    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:23.252160 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:23.252133    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:25.250948 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:25.250864    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:25.251434 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:25.251016    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:25.251598 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:25.251498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:25.251662 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:25.251606    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:25.251715 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:25.251689    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:25.251796 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:25.251765    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:27.251150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:27.251114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:27.251572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:27.251167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:27.251572 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:27.251257    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:27.251572 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:27.251319    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:27.251572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:27.251359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:27.251572 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:27.251449    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:29.251170 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:29.251124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:29.251633 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:29.251124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:29.251633 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:29.251244    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:29.251633 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:29.251263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:29.251633 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:29.251395    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:29.251633 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:29.251476    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:30.834607 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:30.834570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:30.835153 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:30.834687    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:30.835153 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:30.834741    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:25:46.834724403 +0000 UTC m=+34.089064653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:30.935611 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:30.935564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:30.935764 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:30.935709    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:30.935876 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:30.935772    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:46.935757614 +0000 UTC m=+34.190097864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:31.036472 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:31.036440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:31.036618 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.036599    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:31.036618 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.036618    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:31.036717 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.036627    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:31.036717 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.036680    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:47.036662491 +0000 UTC m=+34.291002753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:31.251139 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:31.250986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:31.251139 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:31.251018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:31.251139 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:31.250986    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:31.251139 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.251107    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:31.251473 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.251184    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:31.251473 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:31.251258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:33.252022 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:33.251987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:33.252466 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:33.252093    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:33.252466 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:33.252087    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:33.252466 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:33.252183    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:33.252466 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:33.252198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:33.252466 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:33.252309    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:34.372715 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.372682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"a1caf9ac64d2ad3aec0132074748365f6f4b36658ae328da8a2f773d9e67c2a1"}
Jul 30 20:25:34.374285 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.374260    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q7g6v" event={"ID":"9faef632-53f0-40ef-9668-5826ad553b50","Type":"ContainerStarted","Data":"6d5858c1ecd963a50d0e473a2beaac3a1478e4441c8fb29951aab4f5d3ea43a2"}
Jul 30 20:25:34.375841 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.375816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-57hk4" event={"ID":"833c5003-b29e-4091-be5c-eff60c28dfd5","Type":"ContainerStarted","Data":"15fe794176d5f6488b8d3ce002d0f4d892124ecc1efd34f344cfd2c4d6116220"}
Jul 30 20:25:34.377578 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.377551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2v8xr" event={"ID":"7580ea94-a225-4dee-84bc-6cf34a513593","Type":"ContainerStarted","Data":"83125646dab91e40cf2351d1d62e169aa0975beef3a464be2625dad8a1353873"}
Jul 30 20:25:34.379364 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.379339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerStarted","Data":"44d6be3a83274080e3937a44276f55188c45dadc1c86414c2f1869dc074f4f01"}
Jul 30 20:25:34.380763 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.380738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8zvc" event={"ID":"c488b145-121d-43e5-8b89-390ec20c90a9","Type":"ContainerStarted","Data":"eb4015079d54cce8cfbf2360f3df2e78dc7ab5290960da90798eb3bdfb35f618"}
Jul 30 20:25:34.386268 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.386038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn" event={"ID":"a792d61d-3ae1-4e52-b682-777cabcd8045","Type":"ContainerStarted","Data":"f20e77225f6359a5d5759596769774b9074e6099d2b08101476252c1b493d5ab"}
Jul 30 20:25:34.387674 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.387647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnl78" event={"ID":"99a36f99-8f0f-44f9-84b6-b1c5948a32e4","Type":"ContainerStarted","Data":"d0f771e6bf96cbcf730977c6134d3e6dddc59069f42e02641e4cb5ec370f134d"}
Jul 30 20:25:34.389057 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.389009    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q7g6v" podStartSLOduration=3.535012259 podStartE2EDuration="21.388993812s" totalImagesPullingTime="17.853981553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:34.388606576 +0000 UTC m=+21.642946857" watchObservedRunningTime="2026-07-30 20:25:34.388993812 +0000 UTC m=+21.643334083"
Jul 30 20:25:34.404792 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.404742    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-57hk4" podStartSLOduration=3.548311834 podStartE2EDuration="21.404730734s" totalImagesPullingTime="17.8564189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:34.404550684 +0000 UTC m=+21.658890964" watchObservedRunningTime="2026-07-30 20:25:34.404730734 +0000 UTC m=+21.659070985"
Jul 30 20:25:34.421575 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.421530    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2v8xr" podStartSLOduration=3.558598378 podStartE2EDuration="21.421517475s" totalImagesPullingTime="17.862919097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:34.421456069 +0000 UTC m=+21.675796339" watchObservedRunningTime="2026-07-30 20:25:34.421517475 +0000 UTC m=+21.675857743"
Jul 30 20:25:34.456112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.455961    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8zvc" podStartSLOduration=3.602473618 podStartE2EDuration="21.455945299s" totalImagesPullingTime="17.853471681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:34.455801549 +0000 UTC m=+21.710141815" watchObservedRunningTime="2026-07-30 20:25:34.455945299 +0000 UTC m=+21.710285569"
Jul 30 20:25:34.469897 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:34.469862    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rnl78" podStartSLOduration=7.851700621 podStartE2EDuration="21.469846879s" totalImagesPullingTime="13.618146258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:34.469535852 +0000 UTC m=+21.723876103" watchObservedRunningTime="2026-07-30 20:25:34.469846879 +0000 UTC m=+21.724187147"
Jul 30 20:25:35.251179 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.251154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:35.251320 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.251154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:35.251320 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:35.251247    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:35.251450 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.251339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:35.251450 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:35.251336    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:35.251536 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:35.251455    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:35.390758 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.390733    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="44d6be3a83274080e3937a44276f55188c45dadc1c86414c2f1869dc074f4f01" exitCode=0
Jul 30 20:25:35.391495 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.390812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"44d6be3a83274080e3937a44276f55188c45dadc1c86414c2f1869dc074f4f01"}
Jul 30 20:25:35.393610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.393591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"fe3f02f5131bcf9f26a0c46c43344ec65e1709fa9e967dc5fa682cdc9e7bfeb4"}
Jul 30 20:25:35.393696 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.393651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"21ff6f478f3cd6b66c544ff64acb8922303aced47b224ce2eea5fae51caf6935"}
Jul 30 20:25:35.393696 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.393685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"442098f5b988b6cd2b3aa63bcca9348e752547e4339debaef2e7f65c19cd7ba2"}
Jul 30 20:25:35.393776 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.393721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"5aa32e5bcba3d3f60f83887b311866197305f15ff808f599b284f3cb0a75bc15"}
Jul 30 20:25:35.393776 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.393748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"ad6220bb744f17ffb20a1ff8c29ccce260f1dbe0a22a5183936f9d19fd33131b"}
Jul 30 20:25:35.633231 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:35.633208    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 20:25:36.005459 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.005383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:36.166443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.166335    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T20:25:35.633226863Z","UUID":"5d7988ee-dc44-46d3-bd3e-8e652f01c47a","Handler":null,"Name":"","Endpoint":""}
Jul 30 20:25:36.171967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.171947    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 20:25:36.172095 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.171986    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 20:25:36.398537 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.398453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn" event={"ID":"a792d61d-3ae1-4e52-b682-777cabcd8045","Type":"ContainerStarted","Data":"e64fd217868a5a0c88b9f27685888b00e95a425292e7b88380a5a959827260fe"}
Jul 30 20:25:36.400070 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.400049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgkb4" event={"ID":"65e1bcd6-05dc-4360-a79b-0ea2f1139daa","Type":"ContainerStarted","Data":"8c7cad6da1a9d6573fe8effd036379b8c8d9015b7702e74d84b3139b3c598333"}
Jul 30 20:25:36.414438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:36.414390    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgkb4" podStartSLOduration=5.581733422 podStartE2EDuration="23.414373893s" totalImagesPullingTime="17.832640471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:36.414235382 +0000 UTC m=+23.668575652" watchObservedRunningTime="2026-07-30 20:25:36.414373893 +0000 UTC m=+23.668714163"
Jul 30 20:25:37.250626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.250592    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:37.250883 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.250598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:37.250883 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:37.250712    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:37.250883 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.250598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:37.250883 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:37.250855    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:37.250883 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:37.250791    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:37.405633 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.405598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"e06a6d3f29931f473b6c7f758c14aed9a9e50b35692387509f7f114a9229114e"}
Jul 30 20:25:37.407965 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.407936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn" event={"ID":"a792d61d-3ae1-4e52-b682-777cabcd8045","Type":"ContainerStarted","Data":"c037b9abf98a843f5f6f8c2e043c38fc53062a477313d31e521db47442057b5c"}
Jul 30 20:25:37.427231 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:37.427179    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p4nnn" podStartSLOduration=11.984963759 podStartE2EDuration="24.427165443s" totalImagesPullingTime="12.442201684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:37.426792636 +0000 UTC m=+24.681132896" watchObservedRunningTime="2026-07-30 20:25:37.427165443 +0000 UTC m=+24.681505706"
Jul 30 20:25:38.479636 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:38.479420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:38.480094 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:38.480076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:39.250844 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:39.250766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:39.251029 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:39.250766    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:39.251029 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:39.250939    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:39.251029 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:39.250869    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:39.251029 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:39.250948    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:39.251223 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:39.251094    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:39.412910 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:39.412884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rnl78"
Jul 30 20:25:40.418102 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.417818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" event={"ID":"b45d2665-aa5f-4ef0-8dfa-df675acbaa33","Type":"ContainerStarted","Data":"b3e440664e491dc68d001514c281cc4cb2d2a15b20cf3fc5a8f0653a179df715"}
Jul 30 20:25:40.418653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.418106    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:40.418653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.418157    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:40.419622 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.419598    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="ff19d0e8bd2ea606eac6e1eb8f1c98800e58e529670527c2767688d47d227541" exitCode=0
Jul 30 20:25:40.419725 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.419680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"ff19d0e8bd2ea606eac6e1eb8f1c98800e58e529670527c2767688d47d227541"}
Jul 30 20:25:40.432209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.432189    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:40.444764 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:40.444729    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7" podStartSLOduration=9.4395559 podStartE2EDuration="27.444713969s" totalImagesPullingTime="18.005158069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:40.444056913 +0000 UTC m=+27.698397192" watchObservedRunningTime="2026-07-30 20:25:40.444713969 +0000 UTC m=+27.699054238"
Jul 30 20:25:41.251168 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.251138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:41.251352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.251180    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:41.251352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.251150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:41.251352 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.251253    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:41.251352 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.251328    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:41.251479 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.251392    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:41.422607 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.422534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:41.437351 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.437321    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:25:41.859380 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.859304    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz57t"]
Jul 30 20:25:41.859535 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.859392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:41.859535 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.859491    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:41.862634 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.862608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhdj9"]
Jul 30 20:25:41.862758 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.862697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:41.862833 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.862797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:41.863208 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.863191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txtsm"]
Jul 30 20:25:41.863274 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:41.863262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:41.863353 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:41.863334    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:42.426254 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:42.426221    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="f8482d5c72fdfef26b5425d2bbcb974060328c8d31d83f5feecfe739cb4f87a8" exitCode=0
Jul 30 20:25:42.426698 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:42.426274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"f8482d5c72fdfef26b5425d2bbcb974060328c8d31d83f5feecfe739cb4f87a8"}
Jul 30 20:25:43.252748 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:43.252695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:43.252960 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:43.252804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:43.252960 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:43.252860    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:43.252960 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:43.252928    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:43.252960 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:43.252938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:43.253163 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:43.253022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:44.433180 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:44.432879    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="c2e6a82878eb5ce96ebf277e488d1114ac97138fdca1c51a4ca7fba7525fe3fa" exitCode=0
Jul 30 20:25:44.433180 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:44.432961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"c2e6a82878eb5ce96ebf277e488d1114ac97138fdca1c51a4ca7fba7525fe3fa"}
Jul 30 20:25:45.251707 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:45.251630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:45.251887 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:45.251639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:45.251887 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:45.251766    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:25:45.251887 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:45.251851    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhdj9" podUID="b8f0531f-09e8-4d8d-b67f-669282e39a60"
Jul 30 20:25:45.252039 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:45.251900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:45.252039 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:45.251969    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz57t" podUID="39210573-77a3-499e-8ca2-c9ac83a86910"
Jul 30 20:25:46.862229 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:46.862148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:46.862693 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:46.862322    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:46.862693 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:46.862391    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:26:18.862372464 +0000 UTC m=+66.116712717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:25:46.962491 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:46.962456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:46.962637 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:46.962571    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:46.962637 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:46.962623    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret podName:b8f0531f-09e8-4d8d-b67f-669282e39a60 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:18.962609519 +0000 UTC m=+66.216949767 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret") pod "global-pull-secret-syncer-jhdj9" (UID: "b8f0531f-09e8-4d8d-b67f-669282e39a60") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:25:47.063319 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.063286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:47.063486 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.063412    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:25:47.063486 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.063427    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:25:47.063486 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.063435    2560 projected.go:196] Error preparing data for projected volume kube-api-access-r4mpv for pod openshift-network-diagnostics/network-check-target-sz57t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:47.063486 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.063482    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv podName:39210573-77a3-499e-8ca2-c9ac83a86910 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:19.063465725 +0000 UTC m=+66.317805976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4mpv" (UniqueName: "kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv") pod "network-check-target-sz57t" (UID: "39210573-77a3-499e-8ca2-c9ac83a86910") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:25:47.087203 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.087173    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-183.ec2.internal" event="NodeReady"
Jul 30 20:25:47.087353 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.087305    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 20:25:47.130526 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.130448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2zdbc"]
Jul 30 20:25:47.133222 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.133196    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gwwpv"]
Jul 30 20:25:47.133348 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.133289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.134814 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.134795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.135884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.135864    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 20:25:47.136127 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.136110    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 20:25:47.136204 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.136172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn7n7\""
Jul 30 20:25:47.137355 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.137334    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 20:25:47.137458 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.137367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 20:25:47.137526 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.137489    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-798xg\""
Jul 30 20:25:47.137576 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.137536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 20:25:47.144036 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.143982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2zdbc"]
Jul 30 20:25:47.156699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.156658    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwwpv"]
Jul 30 20:25:47.250811 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.250769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:25:47.250967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.250834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:25:47.250967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.250941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:25:47.254229 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-944cj\""
Jul 30 20:25:47.254229 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254157    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nz9n\""
Jul 30 20:25:47.254404 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254157    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:25:47.254456 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254446    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:25:47.254501 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254453    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:25:47.254700 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.254680    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:25:47.264397 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgdk4\" (UniqueName: \"kubernetes.io/projected/cc7764aa-c457-43ec-b1dd-ed045fd6e707-kube-api-access-zgdk4\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.264489 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be27c3e-8ce8-4548-a810-66b01e3c7305-config-volume\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.264489 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stgtc\" (UniqueName: \"kubernetes.io/projected/0be27c3e-8ce8-4548-a810-66b01e3c7305-kube-api-access-stgtc\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.264563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.264563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be27c3e-8ce8-4548-a810-66b01e3c7305-tmp-dir\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.264635 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.264587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7764aa-c457-43ec-b1dd-ed045fd6e707-cert\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.364949 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.364920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stgtc\" (UniqueName: \"kubernetes.io/projected/0be27c3e-8ce8-4548-a810-66b01e3c7305-kube-api-access-stgtc\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.365084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.364961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.365084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.364989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be27c3e-8ce8-4548-a810-66b01e3c7305-tmp-dir\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.365084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.365049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7764aa-c457-43ec-b1dd-ed045fd6e707-cert\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.365235 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.365090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgdk4\" (UniqueName: \"kubernetes.io/projected/cc7764aa-c457-43ec-b1dd-ed045fd6e707-kube-api-access-zgdk4\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.365235 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.365092    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:47.365235 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.365113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be27c3e-8ce8-4548-a810-66b01e3c7305-config-volume\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.365235 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.365157    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:47.865139002 +0000 UTC m=+35.119479256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:47.365425 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.365366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be27c3e-8ce8-4548-a810-66b01e3c7305-tmp-dir\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.365855 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.365836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0be27c3e-8ce8-4548-a810-66b01e3c7305-config-volume\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.369678 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.369660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc7764aa-c457-43ec-b1dd-ed045fd6e707-cert\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.376401 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.376379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stgtc\" (UniqueName: \"kubernetes.io/projected/0be27c3e-8ce8-4548-a810-66b01e3c7305-kube-api-access-stgtc\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.376902 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.376881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgdk4\" (UniqueName: \"kubernetes.io/projected/cc7764aa-c457-43ec-b1dd-ed045fd6e707-kube-api-access-zgdk4\") pod \"ingress-canary-gwwpv\" (UID: \"cc7764aa-c457-43ec-b1dd-ed045fd6e707\") " pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.451158 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.451101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gwwpv"
Jul 30 20:25:47.869579 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:47.869489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:47.870162 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.869672    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:47.870162 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:47.869750    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:48.869728335 +0000 UTC m=+36.124068586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:48.326234 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:48.326213    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gwwpv"]
Jul 30 20:25:48.329160 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:25:48.329134    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7764aa_c457_43ec_b1dd_ed045fd6e707.slice/crio-6553b9611ac9d1fdc7ea211d42df981ba3b1742ba3402db76f657013bec1f8c2 WatchSource:0}: Error finding container 6553b9611ac9d1fdc7ea211d42df981ba3b1742ba3402db76f657013bec1f8c2: Status 404 returned error can't find the container with id 6553b9611ac9d1fdc7ea211d42df981ba3b1742ba3402db76f657013bec1f8c2
Jul 30 20:25:48.443551 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:48.443520    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="a4cf52e041b98472a8f01190bd275861268c4274bb7766f486d3d49a694b02d6" exitCode=0
Jul 30 20:25:48.443654 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:48.443596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"a4cf52e041b98472a8f01190bd275861268c4274bb7766f486d3d49a694b02d6"}
Jul 30 20:25:48.444728 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:48.444701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwwpv" event={"ID":"cc7764aa-c457-43ec-b1dd-ed045fd6e707","Type":"ContainerStarted","Data":"6553b9611ac9d1fdc7ea211d42df981ba3b1742ba3402db76f657013bec1f8c2"}
Jul 30 20:25:48.879658 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:48.879579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:48.880104 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:48.879714    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:48.880104 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:48.879767    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:50.879754234 +0000 UTC m=+38.134094481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:49.450716 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:49.450673    2560 generic.go:356] "Generic (PLEG): container finished" podID="04324dca-7997-4d87-8c7f-118d186a76ce" containerID="93d59d9c318a777e52a225790343e229aab1c46c106820d842b3dd30e9f87e5b" exitCode=0
Jul 30 20:25:49.450917 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:49.450747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerDied","Data":"93d59d9c318a777e52a225790343e229aab1c46c106820d842b3dd30e9f87e5b"}
Jul 30 20:25:50.458120 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:50.458082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" event={"ID":"04324dca-7997-4d87-8c7f-118d186a76ce","Type":"ContainerStarted","Data":"9e09ca20b687a60ad81a15e9cb1d71d26a80034f8fbd1245acf31885b1c8dd4d"}
Jul 30 20:25:50.483326 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:50.483276    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6hqxj" podStartSLOduration=9.327195733 podStartE2EDuration="37.483257152s" totalImagesPullingTime="28.156061419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:50.482439723 +0000 UTC m=+37.736780027" watchObservedRunningTime="2026-07-30 20:25:50.483257152 +0000 UTC m=+37.737597421"
Jul 30 20:25:50.893775 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:50.893508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:50.893997 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:50.893692    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:50.893997 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:50.893925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:25:54.893905739 +0000 UTC m=+42.148245986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:25:51.461888 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:51.461857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gwwpv" event={"ID":"cc7764aa-c457-43ec-b1dd-ed045fd6e707","Type":"ContainerStarted","Data":"19d0af9228b0ca68c136a39de09ef52bccbfbfdf521d1d193aa18def6b068a1f"}
Jul 30 20:25:54.920927 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:25:54.920892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:25:54.921374 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:54.921031    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:25:54.921374 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:25:54.921104    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:02.921086236 +0000 UTC m=+50.175426487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:26:02.974441 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:02.974407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:26:02.974907 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:02.974513    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:26:02.974907 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:02.974564    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:18.9745488 +0000 UTC m=+66.228889047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:26:13.448618 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:13.448590    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw7l7"
Jul 30 20:26:13.474920 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:13.474870    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gwwpv" podStartSLOduration=24.150803686 podStartE2EDuration="26.474854842s" totalImagesPullingTime="2.324051156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:51.483980035 +0000 UTC m=+38.738320303" watchObservedRunningTime="2026-07-30 20:26:13.474854842 +0000 UTC m=+60.729195110"
Jul 30 20:26:16.702915 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.702881    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"]
Jul 30 20:26:16.705540 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.705517    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"]
Jul 30 20:26:16.705677 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.705622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.707344 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.707324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.708330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.708311    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 20:26:16.708330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.708321    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 30 20:26:16.708454 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.708314    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 20:26:16.708795 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.708767    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 30 20:26:16.709093 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.709076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 20:26:16.709163 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.709076    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 30 20:26:16.709163 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.709125    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 30 20:26:16.709564 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.709546    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 20:26:16.709879 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.709864    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m8p8k\""
Jul 30 20:26:16.716716 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.716695    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"]
Jul 30 20:26:16.717341 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.717322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"]
Jul 30 20:26:16.763790 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85a48524-e8bf-429b-97be-ec68eab89114-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.763891 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblmz\" (UniqueName: \"kubernetes.io/projected/85a48524-e8bf-429b-97be-ec68eab89114-kube-api-access-bblmz\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.763891 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.763970 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.763970 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4206d10-c0f2-4e6e-830d-4954da12a660-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.763970 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsnr\" (UniqueName: \"kubernetes.io/projected/a4206d10-c0f2-4e6e-830d-4954da12a660-kube-api-access-pnsnr\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.764072 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.763993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.764072 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.764016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4206d10-c0f2-4e6e-830d-4954da12a660-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsnr\" (UniqueName: \"kubernetes.io/projected/a4206d10-c0f2-4e6e-830d-4954da12a660-kube-api-access-pnsnr\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865518 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.865559 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85a48524-e8bf-429b-97be-ec68eab89114-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.865743 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.865713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblmz\" (UniqueName: \"kubernetes.io/projected/85a48524-e8bf-429b-97be-ec68eab89114-kube-api-access-bblmz\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.866051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.866028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4206d10-c0f2-4e6e-830d-4954da12a660-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.869190 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.869161    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.869292 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.869275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-ca\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.869344 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.869316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.869382 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.869348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85a48524-e8bf-429b-97be-ec68eab89114-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.869530 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.869495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4206d10-c0f2-4e6e-830d-4954da12a660-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:16.873209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.873190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblmz\" (UniqueName: \"kubernetes.io/projected/85a48524-e8bf-429b-97be-ec68eab89114-kube-api-access-bblmz\") pod \"managed-serviceaccount-addon-agent-657864df86-t2km4\" (UID: \"85a48524-e8bf-429b-97be-ec68eab89114\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:16.873456 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:16.873435    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsnr\" (UniqueName: \"kubernetes.io/projected/a4206d10-c0f2-4e6e-830d-4954da12a660-kube-api-access-pnsnr\") pod \"cluster-proxy-proxy-agent-57875cb6cb-sc22r\" (UID: \"a4206d10-c0f2-4e6e-830d-4954da12a660\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:17.023913 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.023836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:26:17.028382 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.028365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"
Jul 30 20:26:17.149905 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.149875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"]
Jul 30 20:26:17.152543 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:26:17.152515    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4206d10_c0f2_4e6e_830d_4954da12a660.slice/crio-6065e29f519111c5b330c751531b7ec1c146c0a51f691810d4e43c9076ad2ab5 WatchSource:0}: Error finding container 6065e29f519111c5b330c751531b7ec1c146c0a51f691810d4e43c9076ad2ab5: Status 404 returned error can't find the container with id 6065e29f519111c5b330c751531b7ec1c146c0a51f691810d4e43c9076ad2ab5
Jul 30 20:26:17.162302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.162279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4"]
Jul 30 20:26:17.164649 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:26:17.164626    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85a48524_e8bf_429b_97be_ec68eab89114.slice/crio-d9ba8a4164c1ba92a30d39a6b3a12c53e14b9200040175ec873fb7243a3ade8f WatchSource:0}: Error finding container d9ba8a4164c1ba92a30d39a6b3a12c53e14b9200040175ec873fb7243a3ade8f: Status 404 returned error can't find the container with id d9ba8a4164c1ba92a30d39a6b3a12c53e14b9200040175ec873fb7243a3ade8f
Jul 30 20:26:17.520339 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.520300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerStarted","Data":"6065e29f519111c5b330c751531b7ec1c146c0a51f691810d4e43c9076ad2ab5"}
Jul 30 20:26:17.521203 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:17.521182    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4" event={"ID":"85a48524-e8bf-429b-97be-ec68eab89114","Type":"ContainerStarted","Data":"d9ba8a4164c1ba92a30d39a6b3a12c53e14b9200040175ec873fb7243a3ade8f"}
Jul 30 20:26:18.882523 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:18.882481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:26:18.885447 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:18.885233    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:26:18.893549 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:18.893234    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:26:18.893549 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:18.893333    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:27:22.893311495 +0000 UTC m=+130.147651746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : secret "metrics-daemon-secret" not found
Jul 30 20:26:18.983492 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:18.983338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:26:18.983492 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:18.983416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:26:18.983706 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:18.983511    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:26:18.983706 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:18.983572    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:26:50.98355673 +0000 UTC m=+98.237896978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:26:18.986399 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:18.986195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:26:19.002189 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.002141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8f0531f-09e8-4d8d-b67f-669282e39a60-original-pull-secret\") pod \"global-pull-secret-syncer-jhdj9\" (UID: \"b8f0531f-09e8-4d8d-b67f-669282e39a60\") " pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:26:19.061410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.061204    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhdj9"
Jul 30 20:26:19.084473 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.084437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:26:19.087472 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.087446    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:26:19.097702 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.097680    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:26:19.111095 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.111046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mpv\" (UniqueName: \"kubernetes.io/projected/39210573-77a3-499e-8ca2-c9ac83a86910-kube-api-access-r4mpv\") pod \"network-check-target-sz57t\" (UID: \"39210573-77a3-499e-8ca2-c9ac83a86910\") " pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:26:19.377602 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.377571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-944cj\""
Jul 30 20:26:19.385051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:19.385024    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:26:22.443302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.443274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz57t"]
Jul 30 20:26:22.446447 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:26:22.446394    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39210573_77a3_499e_8ca2_c9ac83a86910.slice/crio-df989459c25836126482c299807066a954a1174bf9fcae362114e9d2ab915713 WatchSource:0}: Error finding container df989459c25836126482c299807066a954a1174bf9fcae362114e9d2ab915713: Status 404 returned error can't find the container with id df989459c25836126482c299807066a954a1174bf9fcae362114e9d2ab915713
Jul 30 20:26:22.466599 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.466574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhdj9"]
Jul 30 20:26:22.479940 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:26:22.479913    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f0531f_09e8_4d8d_b67f_669282e39a60.slice/crio-ba1899e38402ccdaf1a794b2bec5d237658cf5768123fce15250a2818b8f480d WatchSource:0}: Error finding container ba1899e38402ccdaf1a794b2bec5d237658cf5768123fce15250a2818b8f480d: Status 404 returned error can't find the container with id ba1899e38402ccdaf1a794b2bec5d237658cf5768123fce15250a2818b8f480d
Jul 30 20:26:22.536504 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.536474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4" event={"ID":"85a48524-e8bf-429b-97be-ec68eab89114","Type":"ContainerStarted","Data":"716f9865848bc95450b92da1346f4e592a7150c61443f7b824ab9fae636417ee"}
Jul 30 20:26:22.537754 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.537729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhdj9" event={"ID":"b8f0531f-09e8-4d8d-b67f-669282e39a60","Type":"ContainerStarted","Data":"ba1899e38402ccdaf1a794b2bec5d237658cf5768123fce15250a2818b8f480d"}
Jul 30 20:26:22.538962 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.538908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz57t" event={"ID":"39210573-77a3-499e-8ca2-c9ac83a86910","Type":"ContainerStarted","Data":"df989459c25836126482c299807066a954a1174bf9fcae362114e9d2ab915713"}
Jul 30 20:26:22.540693 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.540673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerStarted","Data":"a138dadff5c29e193bb46f2d14f1db61c573215709fe1648b2e317e0906a650c"}
Jul 30 20:26:22.540764 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.540703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerStarted","Data":"a3a89636b868af8f4c5327bde398b512725bc8cc3c790f9bbbad60ea492904cf"}
Jul 30 20:26:22.552369 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:22.552324    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4" podStartSLOduration=1.418997977 podStartE2EDuration="6.552311383s" totalImagesPullingTime="5.133313406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:22.551661341 +0000 UTC m=+69.806001610" watchObservedRunningTime="2026-07-30 20:26:22.552311383 +0000 UTC m=+69.806651652"
Jul 30 20:26:23.546203 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:23.546132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerStarted","Data":"2893dbcaab4b08ef4e2e24dcbe2c2e2fb9ee9e3f50bde2096af3a4dcd1a52802"}
Jul 30 20:26:23.564346 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:23.564300    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" podStartSLOduration=2.3649886860000002 podStartE2EDuration="7.564286086s" totalImagesPullingTime="5.1992974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:23.56296221 +0000 UTC m=+70.817302479" watchObservedRunningTime="2026-07-30 20:26:23.564286086 +0000 UTC m=+70.818626333"
Jul 30 20:26:27.559135 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:27.559094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhdj9" event={"ID":"b8f0531f-09e8-4d8d-b67f-669282e39a60","Type":"ContainerStarted","Data":"9e28469717ad4d2fc93ceeb5dcd2ee5b4c140fc54b1d92e58ec0df1863fa8b61"}
Jul 30 20:26:27.560508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:27.560487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz57t" event={"ID":"39210573-77a3-499e-8ca2-c9ac83a86910","Type":"ContainerStarted","Data":"5109d4a650f49c7d1c1c460b65deb6e68a313aecf8d9bec738884fd2406bba23"}
Jul 30 20:26:27.560639 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:27.560623    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:26:27.575875 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:27.575834    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jhdj9" podStartSLOduration=70.086126272 podStartE2EDuration="1m14.575820803s" totalImagesPullingTime="4.489694531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:27.575491906 +0000 UTC m=+74.829832177" watchObservedRunningTime="2026-07-30 20:26:27.575820803 +0000 UTC m=+74.830161071"
Jul 30 20:26:27.590229 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:27.590185    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sz57t" podStartSLOduration=70.071209649 podStartE2EDuration="1m14.590172209s" totalImagesPullingTime="4.51896256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:27.589519516 +0000 UTC m=+74.843859798" watchObservedRunningTime="2026-07-30 20:26:27.590172209 +0000 UTC m=+74.844512478"
Jul 30 20:26:50.991212 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:50.991094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:26:50.991633 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:50.991248    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:26:50.991633 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:26:50.991308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:27:54.991294399 +0000 UTC m=+162.245634647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:26:58.566136 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:26:58.566108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sz57t"
Jul 30 20:27:22.987980 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:27:22.987935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:27:22.988436 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:22.988060    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:27:22.988436 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:22.988110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:29:24.988098155 +0000 UTC m=+252.242438403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : secret "metrics-daemon-secret" not found
Jul 30 20:27:50.144960 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:50.144914    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2zdbc" podUID="0be27c3e-8ce8-4548-a810-66b01e3c7305"
Jul 30 20:27:50.269223 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:50.269195    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:27:50.785189 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:27:50.785159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:27:55.008720 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:27:55.008680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:27:55.009287 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:55.008866    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:27:55.009287 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:27:55.008941    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls podName:0be27c3e-8ce8-4548-a810-66b01e3c7305 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:57.008921124 +0000 UTC m=+284.263261373 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls") pod "dns-default-2zdbc" (UID: "0be27c3e-8ce8-4548-a810-66b01e3c7305") : secret "dns-default-metrics-tls" not found
Jul 30 20:28:05.251344 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:28:05.251258    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:28:22.870433 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:28:22.870403    2560 generic.go:356] "Generic (PLEG): container finished" podID="85a48524-e8bf-429b-97be-ec68eab89114" containerID="716f9865848bc95450b92da1346f4e592a7150c61443f7b824ab9fae636417ee" exitCode=255
Jul 30 20:28:22.870711 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:28:22.870475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4" event={"ID":"85a48524-e8bf-429b-97be-ec68eab89114","Type":"ContainerDied","Data":"716f9865848bc95450b92da1346f4e592a7150c61443f7b824ab9fae636417ee"}
Jul 30 20:28:22.870749 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:28:22.870719    2560 scope.go:117] "RemoveContainer" containerID="716f9865848bc95450b92da1346f4e592a7150c61443f7b824ab9fae636417ee"
Jul 30 20:28:23.874761 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:28:23.874725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-657864df86-t2km4" event={"ID":"85a48524-e8bf-429b-97be-ec68eab89114","Type":"ContainerStarted","Data":"fef432a54f2e68b1673a562a943e5dcbabd47007d0b1e2666b463c54702db3c7"}
Jul 30 20:29:13.457801 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.457755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kqh5n"]
Jul 30 20:29:13.460796 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.460761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.463759 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.463724    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 20:29:13.463759 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.463756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 20:29:13.463932 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.463771    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h92tr\""
Jul 30 20:29:13.463932 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.463852    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 20:29:13.464757 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.464743    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 20:29:13.471483 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.471459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kqh5n"]
Jul 30 20:29:13.503671 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.503652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.503763 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.503682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a12310-3022-4591-a73f-214668a9db09-crio-socket\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.503763 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.503704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a12310-3022-4591-a73f-214668a9db09-data-volume\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.503763 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.503720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.503888 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.503817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgl9r\" (UniqueName: \"kubernetes.io/projected/d0a12310-3022-4591-a73f-214668a9db09-kube-api-access-vgl9r\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604298 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604396 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgl9r\" (UniqueName: \"kubernetes.io/projected/d0a12310-3022-4591-a73f-214668a9db09-kube-api-access-vgl9r\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604396 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:13.604384    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:13.604474 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604474 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:13.604447    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:14.104427643 +0000 UTC m=+241.358767910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:13.604565 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a12310-3022-4591-a73f-214668a9db09-crio-socket\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604565 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:13.604499    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:13.604565 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a12310-3022-4591-a73f-214668a9db09-data-volume\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604565 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:13.604550    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:14.104535006 +0000 UTC m=+241.358875276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:13.604716 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0a12310-3022-4591-a73f-214668a9db09-crio-socket\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.604849 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.604834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0a12310-3022-4591-a73f-214668a9db09-data-volume\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:13.612352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:13.612324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgl9r\" (UniqueName: \"kubernetes.io/projected/d0a12310-3022-4591-a73f-214668a9db09-kube-api-access-vgl9r\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:14.106923 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:14.106891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:14.107212 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:14.106930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:14.107212 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:14.107016    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:14.107212 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:14.107020    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:14.107212 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:14.107110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:15.107077404 +0000 UTC m=+242.361417652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:14.107212 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:14.107152    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:15.107141173 +0000 UTC m=+242.361481420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:15.114629 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.114596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:15.114629 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.114634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:15.115086 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:15.114723    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:15.115086 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:15.114733    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:15.115086 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:15.114771    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:17.11475753 +0000 UTC m=+244.369097778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:15.115086 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:15.114818    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:17.11479859 +0000 UTC m=+244.369138858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:15.620681 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.620655    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8zvc_c488b145-121d-43e5-8b89-390ec20c90a9/dns-node-resolver/0.log"
Jul 30 20:29:15.649657 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.649627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-7x2f5"]
Jul 30 20:29:15.651655 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.651641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.654290 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.654272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 20:29:15.654420 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.654275    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 20:29:15.654420 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.654339    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-whrd4\""
Jul 30 20:29:15.655395 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.655378    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 20:29:15.655533 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.655399    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 20:29:15.661896 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.661877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-7x2f5"]
Jul 30 20:29:15.719415 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.719391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/682155eb-7032-4da5-807b-36f1ab749f76-signing-cabundle\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.719495 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.719438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txz6k\" (UniqueName: \"kubernetes.io/projected/682155eb-7032-4da5-807b-36f1ab749f76-kube-api-access-txz6k\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.719495 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.719454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/682155eb-7032-4da5-807b-36f1ab749f76-signing-key\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.820377 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.820346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/682155eb-7032-4da5-807b-36f1ab749f76-signing-cabundle\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.820443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.820403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txz6k\" (UniqueName: \"kubernetes.io/projected/682155eb-7032-4da5-807b-36f1ab749f76-kube-api-access-txz6k\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.820443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.820428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/682155eb-7032-4da5-807b-36f1ab749f76-signing-key\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.820966 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.820947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/682155eb-7032-4da5-807b-36f1ab749f76-signing-cabundle\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.822655 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.822636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/682155eb-7032-4da5-807b-36f1ab749f76-signing-key\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.828345 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.828319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txz6k\" (UniqueName: \"kubernetes.io/projected/682155eb-7032-4da5-807b-36f1ab749f76-kube-api-access-txz6k\") pod \"service-ca-98c88fbb5-7x2f5\" (UID: \"682155eb-7032-4da5-807b-36f1ab749f76\") " pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:15.960472 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:15.960418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5"
Jul 30 20:29:16.076507 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:16.076476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-7x2f5"]
Jul 30 20:29:16.079181 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:16.079155    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682155eb_7032_4da5_807b_36f1ab749f76.slice/crio-0a3aab2fda95fc2129d16f3cae991a82f2a84d517af899fb5525d3716f8b93fb WatchSource:0}: Error finding container 0a3aab2fda95fc2129d16f3cae991a82f2a84d517af899fb5525d3716f8b93fb: Status 404 returned error can't find the container with id 0a3aab2fda95fc2129d16f3cae991a82f2a84d517af899fb5525d3716f8b93fb
Jul 30 20:29:16.622204 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:16.622180    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q7g6v_9faef632-53f0-40ef-9668-5826ad553b50/node-ca/0.log"
Jul 30 20:29:17.016069 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:17.015997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5" event={"ID":"682155eb-7032-4da5-807b-36f1ab749f76","Type":"ContainerStarted","Data":"0a3aab2fda95fc2129d16f3cae991a82f2a84d517af899fb5525d3716f8b93fb"}
Jul 30 20:29:17.131964 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:17.131937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:17.132231 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:17.132007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:17.132231 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:17.132073    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:17.132231 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:17.132143    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:21.132124871 +0000 UTC m=+248.386465120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:17.132231 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:17.132075    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:17.132231 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:17.132222    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:21.132205976 +0000 UTC m=+248.386546228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:17.219539 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:17.219486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwwpv_cc7764aa-c457-43ec-b1dd-ed045fd6e707/serve-healthcheck-canary/0.log"
Jul 30 20:29:18.020606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:18.020576    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5" event={"ID":"682155eb-7032-4da5-807b-36f1ab749f76","Type":"ContainerStarted","Data":"93ac54b0f0fbbeaf1bfbe853fa5c11f5df91d04f6b1be3c21853c173652844fd"}
Jul 30 20:29:18.036716 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:18.036671    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-7x2f5" podStartSLOduration=1.3045305520000001 podStartE2EDuration="3.036657258s" totalImagesPullingTime="1.732126706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:18.035120796 +0000 UTC m=+245.289461066" watchObservedRunningTime="2026-07-30 20:29:18.036657258 +0000 UTC m=+245.290997541"
Jul 30 20:29:21.162140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:21.162106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:21.162494 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:21.162171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:21.162494 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:21.162233    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:29:21.162494 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:21.162269    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:21.162494 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:21.162286    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:29.162271595 +0000 UTC m=+256.416611842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : configmap "kube-rbac-proxy" not found
Jul 30 20:29:21.162494 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:21.162331    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls podName:d0a12310-3022-4591-a73f-214668a9db09 nodeName:}" failed. No retries permitted until 2026-07-30 20:29:29.162313467 +0000 UTC m=+256.416653719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kqh5n" (UID: "d0a12310-3022-4591-a73f-214668a9db09") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:29:24.988287 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:24.988255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:29:24.988709 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:24.988422    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 20:29:24.988908 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:24.988752    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs podName:6d3c8fce-3fb6-4f90-bc76-65faf3011d8a nodeName:}" failed. No retries permitted until 2026-07-30 20:31:26.988713228 +0000 UTC m=+374.243053496 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs") pod "network-metrics-daemon-txtsm" (UID: "6d3c8fce-3fb6-4f90-bc76-65faf3011d8a") : secret "metrics-daemon-secret" not found
Jul 30 20:29:29.216868 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.216826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:29.216868 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.216878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:29.217338 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.217319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0a12310-3022-4591-a73f-214668a9db09-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:29.219117 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.219100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0a12310-3022-4591-a73f-214668a9db09-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kqh5n\" (UID: \"d0a12310-3022-4591-a73f-214668a9db09\") " pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:29.370745 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.370708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kqh5n"
Jul 30 20:29:29.485810 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:29.485714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kqh5n"]
Jul 30 20:29:29.488173 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:29.488143    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a12310_3022_4591_a73f_214668a9db09.slice/crio-036bd075a7ba7de44ccf7952a28e36ca616e550c12351a78d4bd9bf2d3c19ccc WatchSource:0}: Error finding container 036bd075a7ba7de44ccf7952a28e36ca616e550c12351a78d4bd9bf2d3c19ccc: Status 404 returned error can't find the container with id 036bd075a7ba7de44ccf7952a28e36ca616e550c12351a78d4bd9bf2d3c19ccc
Jul 30 20:29:30.056503 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:30.056470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kqh5n" event={"ID":"d0a12310-3022-4591-a73f-214668a9db09","Type":"ContainerStarted","Data":"61a6e961cfc84021ed7f1ad6c1aca680b734cab120b4fcf44ad8b1bceb5a3c6a"}
Jul 30 20:29:30.056694 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:30.056530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kqh5n" event={"ID":"d0a12310-3022-4591-a73f-214668a9db09","Type":"ContainerStarted","Data":"036bd075a7ba7de44ccf7952a28e36ca616e550c12351a78d4bd9bf2d3c19ccc"}
Jul 30 20:29:31.061946 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:31.061907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kqh5n" event={"ID":"d0a12310-3022-4591-a73f-214668a9db09","Type":"ContainerStarted","Data":"b3009260cb67d8e7c0bd60f21c59a2b51f7dd4c0b92567ad17fadb5f3952ee0c"}
Jul 30 20:29:32.067213 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:32.067172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kqh5n" event={"ID":"d0a12310-3022-4591-a73f-214668a9db09","Type":"ContainerStarted","Data":"f754361c4510c79aaa57fd4690f6af7a859578fac3641c0d0574f909163ac908"}
Jul 30 20:29:32.087438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:32.087395    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kqh5n" podStartSLOduration=16.974964121 podStartE2EDuration="19.087382299s" totalImagesPullingTime="2.112418178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:29:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:32.086609517 +0000 UTC m=+259.340949797" watchObservedRunningTime="2026-07-30 20:29:32.087382299 +0000 UTC m=+259.341722567"
Jul 30 20:29:38.393044 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.392969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d55b55565-5nbc5"]
Jul 30 20:29:38.395089 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.395073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.397712 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.397691    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 20:29:38.397934 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.397922    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 20:29:38.398212 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.398199    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 20:29:38.398481 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.398466    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzftn\""
Jul 30 20:29:38.403422 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.403403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 20:29:38.410503 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.410483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d55b55565-5nbc5"]
Jul 30 20:29:38.478046 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97hmv\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-kube-api-access-97hmv\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478142 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b2e4457-04a5-42ed-adba-79f2fb5aad79-ca-trust-extracted\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478142 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-certificates\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-image-registry-private-configuration\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-installation-pull-secrets\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478272 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-tls\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478272 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-trusted-ca\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.478272 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.478237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-bound-sa-token\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.578967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.578947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97hmv\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-kube-api-access-97hmv\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579060 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.578974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b2e4457-04a5-42ed-adba-79f2fb5aad79-ca-trust-extracted\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579060 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.578995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-certificates\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579060 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-image-registry-private-configuration\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579060 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-installation-pull-secrets\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-tls\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-trusted-ca\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-bound-sa-token\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.579405 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b2e4457-04a5-42ed-adba-79f2fb5aad79-ca-trust-extracted\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.580001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.579977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-certificates\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.580144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.580039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b2e4457-04a5-42ed-adba-79f2fb5aad79-trusted-ca\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.581496 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.581472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-installation-pull-secrets\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.581671 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.581651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-registry-tls\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.581733 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.581668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b2e4457-04a5-42ed-adba-79f2fb5aad79-image-registry-private-configuration\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.588413 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.588395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97hmv\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-kube-api-access-97hmv\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.590318 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.590298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b2e4457-04a5-42ed-adba-79f2fb5aad79-bound-sa-token\") pod \"image-registry-6d55b55565-5nbc5\" (UID: \"5b2e4457-04a5-42ed-adba-79f2fb5aad79\") " pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.704176 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.704126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:38.824090 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:38.824057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d55b55565-5nbc5"]
Jul 30 20:29:38.825991 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:38.825967    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2e4457_04a5_42ed_adba_79f2fb5aad79.slice/crio-069f4b3603998b07a9c0f896c775b05cbcf5374cf5671faf146008f1927cb9f3 WatchSource:0}: Error finding container 069f4b3603998b07a9c0f896c775b05cbcf5374cf5671faf146008f1927cb9f3: Status 404 returned error can't find the container with id 069f4b3603998b07a9c0f896c775b05cbcf5374cf5671faf146008f1927cb9f3
Jul 30 20:29:39.087515 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:39.087485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5" event={"ID":"5b2e4457-04a5-42ed-adba-79f2fb5aad79","Type":"ContainerStarted","Data":"40f51876e7aeda13531ca393991d4fa3e055fe10952d6739895773b23c1bfbc3"}
Jul 30 20:29:39.087690 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:39.087528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5" event={"ID":"5b2e4457-04a5-42ed-adba-79f2fb5aad79","Type":"ContainerStarted","Data":"069f4b3603998b07a9c0f896c775b05cbcf5374cf5671faf146008f1927cb9f3"}
Jul 30 20:29:39.087690 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:39.087627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:29:39.106185 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:39.106141    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5" podStartSLOduration=1.106126174 podStartE2EDuration="1.106126174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:39.105217649 +0000 UTC m=+266.359557917" watchObservedRunningTime="2026-07-30 20:29:39.106126174 +0000 UTC m=+266.360466444"
Jul 30 20:29:51.650203 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.650166    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d6qkj"]
Jul 30 20:29:51.656263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.656232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.658480 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.658458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 20:29:51.658738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.658721    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwh68\""
Jul 30 20:29:51.659030 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.659002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 20:29:51.660273 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.660078    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 20:29:51.660273 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.660121    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 20:29:51.660273 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.660149    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 20:29:51.660273 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.660166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 20:29:51.763341 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763519 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-root\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763519 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ckx\" (UniqueName: \"kubernetes.io/projected/3fd813b5-76cc-492e-8356-300515724a6a-kube-api-access-92ckx\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763519 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763471    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-metrics-client-ca\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763519 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-tls\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763697 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-wtmp\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763697 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-sys\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763697 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.763697 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.763624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-textfile\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864348 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-sys\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-textfile\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-sys\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864751 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-root\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864751 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ckx\" (UniqueName: \"kubernetes.io/projected/3fd813b5-76cc-492e-8356-300515724a6a-kube-api-access-92ckx\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864751 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-metrics-client-ca\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864751 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-tls\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-textfile\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-wtmp\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.864967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.864902    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-wtmp\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.865113 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.865065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.865167 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.865129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3fd813b5-76cc-492e-8356-300515724a6a-root\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.865376 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.865355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd813b5-76cc-492e-8356-300515724a6a-metrics-client-ca\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.867934 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.867911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.868430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.868409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3fd813b5-76cc-492e-8356-300515724a6a-node-exporter-tls\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.873026 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.873005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ckx\" (UniqueName: \"kubernetes.io/projected/3fd813b5-76cc-492e-8356-300515724a6a-kube-api-access-92ckx\") pod \"node-exporter-d6qkj\" (UID: \"3fd813b5-76cc-492e-8356-300515724a6a\") " pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.966042 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:51.965959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6qkj"
Jul 30 20:29:51.976144 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:51.976117    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd813b5_76cc_492e_8356_300515724a6a.slice/crio-6c141c1d981cf2aef178df333f871d874bf99e09185b43ad4db2f99ccb213e37 WatchSource:0}: Error finding container 6c141c1d981cf2aef178df333f871d874bf99e09185b43ad4db2f99ccb213e37: Status 404 returned error can't find the container with id 6c141c1d981cf2aef178df333f871d874bf99e09185b43ad4db2f99ccb213e37
Jul 30 20:29:52.126770 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:52.126735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6qkj" event={"ID":"3fd813b5-76cc-492e-8356-300515724a6a","Type":"ContainerStarted","Data":"6c141c1d981cf2aef178df333f871d874bf99e09185b43ad4db2f99ccb213e37"}
Jul 30 20:29:53.130623 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:53.130597    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fd813b5-76cc-492e-8356-300515724a6a" containerID="0502f27b43ca9b5d0c6de27eb9d975a917947fe5c54682e99d3c41846eafe09e" exitCode=0
Jul 30 20:29:53.130931 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:53.130668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6qkj" event={"ID":"3fd813b5-76cc-492e-8356-300515724a6a","Type":"ContainerDied","Data":"0502f27b43ca9b5d0c6de27eb9d975a917947fe5c54682e99d3c41846eafe09e"}
Jul 30 20:29:53.785973 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:29:53.785939    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2zdbc" podUID="0be27c3e-8ce8-4548-a810-66b01e3c7305"
Jul 30 20:29:54.136114 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:54.136084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:29:54.136114 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:54.136099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6qkj" event={"ID":"3fd813b5-76cc-492e-8356-300515724a6a","Type":"ContainerStarted","Data":"f82094a2f4624f83fb696a1dfc5b32eeffc43abc88630145c206747cf79a2d2a"}
Jul 30 20:29:54.136508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:54.136145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6qkj" event={"ID":"3fd813b5-76cc-492e-8356-300515724a6a","Type":"ContainerStarted","Data":"d023443186db8f1a04d34c3e6595e3f6f03ed5ccd52e6b71280ad3046f5d3d03"}
Jul 30 20:29:54.155962 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:54.155919    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d6qkj" podStartSLOduration=2.143346468 podStartE2EDuration="3.155905625s" totalImagesPullingTime="950.913447ms" totalInitContainerRuntime="61.64571ms" isStatefulPod=true podCreationTimestamp="2026-07-30 20:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:54.154288532 +0000 UTC m=+281.408628801" watchObservedRunningTime="2026-07-30 20:29:54.155905625 +0000 UTC m=+281.410245893"
Jul 30 20:29:57.100760 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.100725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:29:57.102854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.102837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be27c3e-8ce8-4548-a810-66b01e3c7305-metrics-tls\") pod \"dns-default-2zdbc\" (UID: \"0be27c3e-8ce8-4548-a810-66b01e3c7305\") " pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:29:57.139520 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.139498    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tn7n7\""
Jul 30 20:29:57.147661 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.147646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:29:57.267112 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.267083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2zdbc"]
Jul 30 20:29:57.269501 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:57.269474    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be27c3e_8ce8_4548_a810_66b01e3c7305.slice/crio-b621cb8327af53dbccf47abd1ec1b49c08b11497189f8b4b2f7b0934fdf2648e WatchSource:0}: Error finding container b621cb8327af53dbccf47abd1ec1b49c08b11497189f8b4b2f7b0934fdf2648e: Status 404 returned error can't find the container with id b621cb8327af53dbccf47abd1ec1b49c08b11497189f8b4b2f7b0934fdf2648e
Jul 30 20:29:57.888630 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.888593    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:29:57.891081 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.891051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:57.893836 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.893808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 20:29:57.893956 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.893856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 20:29:57.893956 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.893882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5s1snjjch6ei\""
Jul 30 20:29:57.894043 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 20:29:57.894438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894223    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 20:29:57.894438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894268    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 20:29:57.894438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894277    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 20:29:57.894438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894268    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 20:29:57.895090 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894890    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 20:29:57.895090 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.894918    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dhwlc\""
Jul 30 20:29:57.895224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895164    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 20:29:57.895224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895197    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 20:29:57.895321 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895265    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 20:29:57.895388 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895373    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 20:29:57.895615 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895596    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 20:29:57.895749 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.895733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 20:29:57.897734 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.897714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 20:29:57.908934 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:57.908912    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:29:58.006715 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.006869 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.006869 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.006869 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.006869 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.006996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b742c\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.007581 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.007304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.108584 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.108584 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.108962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109661 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109661 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109661 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109814 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b742c\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109814 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109814 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.109967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.109946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.110543 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.110219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.110543 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.110401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.112088 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.112056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.112512 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.112484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.112710 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.112683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.112990 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.112967    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.113355 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.113330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.113950 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.113911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.114097 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.114080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.114181 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.114160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.114230 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.114184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.114321 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.114300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.114662 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.114644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.115135 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.115118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.120618 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.120597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b742c\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c\") pod \"prometheus-k8s-0\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.148988 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.148935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zdbc" event={"ID":"0be27c3e-8ce8-4548-a810-66b01e3c7305","Type":"ContainerStarted","Data":"b621cb8327af53dbccf47abd1ec1b49c08b11497189f8b4b2f7b0934fdf2648e"}
Jul 30 20:29:58.202583 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.202560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:29:58.344995 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:58.344844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:29:58.347983 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:29:58.347952    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acb6400_89ff_414c_9de1_1b00e376323c.slice/crio-35bface3acd68c16e0105a69737f3389819184643845657f533ea35148c4b81c WatchSource:0}: Error finding container 35bface3acd68c16e0105a69737f3389819184643845657f533ea35148c4b81c: Status 404 returned error can't find the container with id 35bface3acd68c16e0105a69737f3389819184643845657f533ea35148c4b81c
Jul 30 20:29:59.154833 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:59.154743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zdbc" event={"ID":"0be27c3e-8ce8-4548-a810-66b01e3c7305","Type":"ContainerStarted","Data":"0ddefda83989cb973a2cf238d798f2ff986bcdd434105c56b3d9478d991d40f7"}
Jul 30 20:29:59.154833 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:59.154822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2zdbc" event={"ID":"0be27c3e-8ce8-4548-a810-66b01e3c7305","Type":"ContainerStarted","Data":"36e810816ac966e5a0ac0e9942e2c5d263379eb1c17226fe3c8389a3b6d19903"}
Jul 30 20:29:59.155278 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:59.154856    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:29:59.156136 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:59.156109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"35bface3acd68c16e0105a69737f3389819184643845657f533ea35148c4b81c"}
Jul 30 20:29:59.172736 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:29:59.172698    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2zdbc" podStartSLOduration=250.566729313 podStartE2EDuration="4m12.172680834s" totalImagesPullingTime="1.605951521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:59.171556227 +0000 UTC m=+286.425896529" watchObservedRunningTime="2026-07-30 20:29:59.172680834 +0000 UTC m=+286.427021104"
Jul 30 20:30:00.095108 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:00.095080    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d55b55565-5nbc5"
Jul 30 20:30:00.161133 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:00.161105    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="274510c15ff7366d3c7428a9c879d1fb5b9819eb3799b5275b15cba3e01a28c7" exitCode=0
Jul 30 20:30:00.161480 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:00.161191    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"274510c15ff7366d3c7428a9c879d1fb5b9819eb3799b5275b15cba3e01a28c7"}
Jul 30 20:30:04.177955 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:04.177917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"527a2cb1854c0ca6559090fa624afaa37bf5a5fa1e82e2a1e659c59704cac45d"}
Jul 30 20:30:04.178338 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:04.178000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"b876ebf336089f4eb4b044c807062edbb5f268b3d15194fb7a8175ab37fd8449"}
Jul 30 20:30:05.185541 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:05.185517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"e9b370f38f0b6fc7200aa9f296c43f9488eec05033a93c6de34918a4dc239c47"}
Jul 30 20:30:05.186067 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:05.186045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"3cb4c27c55369cc7a88750f1936afcabb59a914172f7318c2d7f3cdd65942d64"}
Jul 30 20:30:06.192568 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:06.192533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"e5fddc5914c4eb9e1fdbe70e50a077dc91a674f0d125cc3c645c4094e40c5c1b"}
Jul 30 20:30:06.192985 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:06.192596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerStarted","Data":"80dfab1e45cf96a8b64a99d29295b35086c54b8294cd10a613f1aed82cac6869"}
Jul 30 20:30:06.220508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:06.220455    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.3229632479999998 podStartE2EDuration="9.22043755s" totalImagesPullingTime="5.879557282s" totalInitContainerRuntime="17.91702ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:30:06.21840549 +0000 UTC m=+293.472745780" watchObservedRunningTime="2026-07-30 20:30:06.22043755 +0000 UTC m=+293.474777819"
Jul 30 20:30:08.203298 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:08.203266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:30:08.252548 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:30:08.252513    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txtsm" podUID="6d3c8fce-3fb6-4f90-bc76-65faf3011d8a"
Jul 30 20:30:09.163413 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:09.163385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2zdbc"
Jul 30 20:30:13.122809 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:13.122775    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 20:30:23.252241 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:23.252197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:30:37.025267 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:37.025224    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" podUID="a4206d10-c0f2-4e6e-830d-4954da12a660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 30 20:30:47.025835 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:47.025769    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" podUID="a4206d10-c0f2-4e6e-830d-4954da12a660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 30 20:30:57.025158 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.025122    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" podUID="a4206d10-c0f2-4e6e-830d-4954da12a660" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 30 20:30:57.025608 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.025183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r"
Jul 30 20:30:57.025608 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.025553    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2893dbcaab4b08ef4e2e24dcbe2c2e2fb9ee9e3f50bde2096af3a4dcd1a52802"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 30 20:30:57.025710 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.025618    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" podUID="a4206d10-c0f2-4e6e-830d-4954da12a660" containerName="service-proxy" containerID="cri-o://2893dbcaab4b08ef4e2e24dcbe2c2e2fb9ee9e3f50bde2096af3a4dcd1a52802" gracePeriod=30
Jul 30 20:30:57.360038 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.360009    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4206d10-c0f2-4e6e-830d-4954da12a660" containerID="2893dbcaab4b08ef4e2e24dcbe2c2e2fb9ee9e3f50bde2096af3a4dcd1a52802" exitCode=2
Jul 30 20:30:57.360159 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.360050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerDied","Data":"2893dbcaab4b08ef4e2e24dcbe2c2e2fb9ee9e3f50bde2096af3a4dcd1a52802"}
Jul 30 20:30:57.360159 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:57.360082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57875cb6cb-sc22r" event={"ID":"a4206d10-c0f2-4e6e-830d-4954da12a660","Type":"ContainerStarted","Data":"022d9f25b9183a937b691245f4869bf1d97001eb7c9e3172609b744facd6e787"}
Jul 30 20:30:58.203572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:58.203542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:30:58.221472 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:58.221449    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:30:58.378072 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:30:58.378051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:16.298130 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298056    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:16.298502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298356    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="prometheus" containerID="cri-o://b876ebf336089f4eb4b044c807062edbb5f268b3d15194fb7a8175ab37fd8449" gracePeriod=600
Jul 30 20:31:16.298502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298394    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy" containerID="cri-o://80dfab1e45cf96a8b64a99d29295b35086c54b8294cd10a613f1aed82cac6869" gracePeriod=600
Jul 30 20:31:16.298502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298427    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="thanos-sidecar" containerID="cri-o://3cb4c27c55369cc7a88750f1936afcabb59a914172f7318c2d7f3cdd65942d64" gracePeriod=600
Jul 30 20:31:16.298502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298440    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-web" containerID="cri-o://e9b370f38f0b6fc7200aa9f296c43f9488eec05033a93c6de34918a4dc239c47" gracePeriod=600
Jul 30 20:31:16.298502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298461    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="config-reloader" containerID="cri-o://527a2cb1854c0ca6559090fa624afaa37bf5a5fa1e82e2a1e659c59704cac45d" gracePeriod=600
Jul 30 20:31:16.298738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.298401    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e5fddc5914c4eb9e1fdbe70e50a077dc91a674f0d125cc3c645c4094e40c5c1b" gracePeriod=600
Jul 30 20:31:16.422462 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422430    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="e5fddc5914c4eb9e1fdbe70e50a077dc91a674f0d125cc3c645c4094e40c5c1b" exitCode=0
Jul 30 20:31:16.422462 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422455    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="80dfab1e45cf96a8b64a99d29295b35086c54b8294cd10a613f1aed82cac6869" exitCode=0
Jul 30 20:31:16.422462 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422464    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="e9b370f38f0b6fc7200aa9f296c43f9488eec05033a93c6de34918a4dc239c47" exitCode=0
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422470    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="3cb4c27c55369cc7a88750f1936afcabb59a914172f7318c2d7f3cdd65942d64" exitCode=0
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422476    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="527a2cb1854c0ca6559090fa624afaa37bf5a5fa1e82e2a1e659c59704cac45d" exitCode=0
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422481    2560 generic.go:356] "Generic (PLEG): container finished" podID="1acb6400-89ff-414c-9de1-1b00e376323c" containerID="b876ebf336089f4eb4b044c807062edbb5f268b3d15194fb7a8175ab37fd8449" exitCode=0
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"e5fddc5914c4eb9e1fdbe70e50a077dc91a674f0d125cc3c645c4094e40c5c1b"}
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"80dfab1e45cf96a8b64a99d29295b35086c54b8294cd10a613f1aed82cac6869"}
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"e9b370f38f0b6fc7200aa9f296c43f9488eec05033a93c6de34918a4dc239c47"}
Jul 30 20:31:16.422626 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"3cb4c27c55369cc7a88750f1936afcabb59a914172f7318c2d7f3cdd65942d64"}
Jul 30 20:31:16.422858 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422638    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"527a2cb1854c0ca6559090fa624afaa37bf5a5fa1e82e2a1e659c59704cac45d"}
Jul 30 20:31:16.422858 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.422661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"b876ebf336089f4eb4b044c807062edbb5f268b3d15194fb7a8175ab37fd8449"}
Jul 30 20:31:16.526399 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.526373    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:16.596619 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596766 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596629    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596766 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596766 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596674    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596952 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596952 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596871    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596952 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.596952 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596933    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.596967    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597005    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597047    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597140 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597155    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597197    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b742c\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597257    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597260    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.597421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597998 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597690    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.597998 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597739    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597998 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy\") pod \"1acb6400-89ff-414c-9de1-1b00e376323c\" (UID: \"1acb6400-89ff-414c-9de1-1b00e376323c\") "
Jul 30 20:31:16.597998 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.597830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.598286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598033    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.598286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598053    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-metrics-client-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.598286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598068    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.598286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598082    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.598489 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598406    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.598937 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.598913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.599560 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.599534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:31:16.600296 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.600248    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config" (OuterVolumeSpecName: "config") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.600421 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.600387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:16.600935 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.600906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out" (OuterVolumeSpecName: "config-out") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:31:16.601465 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.601465 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.601617 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.601680 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.601876 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.601976 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.601934    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.602513 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.602496    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:31:16.602637 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.602622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.603151 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.603120    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c" (OuterVolumeSpecName: "kube-api-access-b742c") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "kube-api-access-b742c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:31:16.609710 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.609691    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config" (OuterVolumeSpecName: "web-config") pod "1acb6400-89ff-414c-9de1-1b00e376323c" (UID: "1acb6400-89ff-414c-9de1-1b00e376323c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:31:16.698475 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698448    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-tls-assets\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698475 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698471    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b742c\" (UniqueName: \"kubernetes.io/projected/1acb6400-89ff-414c-9de1-1b00e376323c-kube-api-access-b742c\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698475 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698481    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698489    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-config\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698498    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-metrics-client-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698507    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-kube-rbac-proxy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698515    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698523    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698531    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-grpc-tls\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698539    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-config-out\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698547    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698555    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698564    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698572    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-web-config\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698580    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1acb6400-89ff-414c-9de1-1b00e376323c-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:16.698652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:16.698588    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1acb6400-89ff-414c-9de1-1b00e376323c-prometheus-k8s-db\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:31:17.428954 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.428928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1acb6400-89ff-414c-9de1-1b00e376323c","Type":"ContainerDied","Data":"35bface3acd68c16e0105a69737f3389819184643845657f533ea35148c4b81c"}
Jul 30 20:31:17.429286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.428980    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.429286 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.428997    2560 scope.go:117] "RemoveContainer" containerID="e5fddc5914c4eb9e1fdbe70e50a077dc91a674f0d125cc3c645c4094e40c5c1b"
Jul 30 20:31:17.436270 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.436255    2560 scope.go:117] "RemoveContainer" containerID="80dfab1e45cf96a8b64a99d29295b35086c54b8294cd10a613f1aed82cac6869"
Jul 30 20:31:17.443133 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.443118    2560 scope.go:117] "RemoveContainer" containerID="e9b370f38f0b6fc7200aa9f296c43f9488eec05033a93c6de34918a4dc239c47"
Jul 30 20:31:17.448837 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.448819    2560 scope.go:117] "RemoveContainer" containerID="3cb4c27c55369cc7a88750f1936afcabb59a914172f7318c2d7f3cdd65942d64"
Jul 30 20:31:17.452939 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.452910    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:17.455501 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.455479    2560 scope.go:117] "RemoveContainer" containerID="527a2cb1854c0ca6559090fa624afaa37bf5a5fa1e82e2a1e659c59704cac45d"
Jul 30 20:31:17.457145 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.457129    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:17.461438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.461422    2560 scope.go:117] "RemoveContainer" containerID="b876ebf336089f4eb4b044c807062edbb5f268b3d15194fb7a8175ab37fd8449"
Jul 30 20:31:17.467732 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.467717    2560 scope.go:117] "RemoveContainer" containerID="274510c15ff7366d3c7428a9c879d1fb5b9819eb3799b5275b15cba3e01a28c7"
Jul 30 20:31:17.490528 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490503    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:17.490755 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490739    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-web"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490758    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-web"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490771    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="prometheus"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490792    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="prometheus"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="init-config-reloader"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490822    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="init-config-reloader"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490831    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490839    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy"
Jul 30 20:31:17.490852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490851    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="config-reloader"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490859    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="config-reloader"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490868    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="thanos-sidecar"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490875    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="thanos-sidecar"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490887    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-thanos"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490895    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-thanos"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490953    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490966    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-thanos"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490976    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="prometheus"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490984    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="kube-rbac-proxy-web"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.490993    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="config-reloader"
Jul 30 20:31:17.491224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.491000    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" containerName="thanos-sidecar"
Jul 30 20:31:17.495572 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.495555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.498116 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 20:31:17.498253 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498103    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 20:31:17.498253 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498103    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 20:31:17.498505 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 20:31:17.498505 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dhwlc\""
Jul 30 20:31:17.498505 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 20:31:17.498825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498560    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 20:31:17.498825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498663    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 20:31:17.498825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 20:31:17.499058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498912    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 20:31:17.499058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 20:31:17.499058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.498940    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 20:31:17.499058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.499045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f5s1snjjch6ei\""
Jul 30 20:31:17.499343 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.499117    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 20:31:17.499383 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.499368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 20:31:17.502256 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.502235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 20:31:17.503653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrj8\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-kube-api-access-zqrj8\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503653 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503747    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.503860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.503974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504156    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.504888 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.504590    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 20:31:17.508841 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.508821    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:17.604710 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.604854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.604854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.604854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.604854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.604854 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.604964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605395 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.605301    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.605717 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.605536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.607857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrj8\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-kube-api-access-zqrj8\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608538    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608985 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.608985 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.608918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609478 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609707 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609707 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609872 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.609974 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.609951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-config\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.611009 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.610991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2c8f0a6-7b62-4299-94fe-395bfa911b93-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.611519 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.611502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2c8f0a6-7b62-4299-94fe-395bfa911b93-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.616860 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.616841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrj8\" (UniqueName: \"kubernetes.io/projected/d2c8f0a6-7b62-4299-94fe-395bfa911b93-kube-api-access-zqrj8\") pod \"prometheus-k8s-0\" (UID: \"d2c8f0a6-7b62-4299-94fe-395bfa911b93\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.805754 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.805726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:17.935640 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:17.935613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:31:17.937388 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:31:17.937362    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c8f0a6_7b62_4299_94fe_395bfa911b93.slice/crio-ff23a48ad810023a30dd88492fe9970c72743000ebeffa7f86a5528d7fbf58f2 WatchSource:0}: Error finding container ff23a48ad810023a30dd88492fe9970c72743000ebeffa7f86a5528d7fbf58f2: Status 404 returned error can't find the container with id ff23a48ad810023a30dd88492fe9970c72743000ebeffa7f86a5528d7fbf58f2
Jul 30 20:31:18.434088 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:18.434057    2560 generic.go:356] "Generic (PLEG): container finished" podID="d2c8f0a6-7b62-4299-94fe-395bfa911b93" containerID="2735e77136258e2ce94622adfb1cbe56e1af4258aaf09db24d87cbc30800e05a" exitCode=0
Jul 30 20:31:18.434530 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:18.434142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerDied","Data":"2735e77136258e2ce94622adfb1cbe56e1af4258aaf09db24d87cbc30800e05a"}
Jul 30 20:31:18.434530 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:18.434232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"ff23a48ad810023a30dd88492fe9970c72743000ebeffa7f86a5528d7fbf58f2"}
Jul 30 20:31:19.255227 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.255192    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1acb6400-89ff-414c-9de1-1b00e376323c" path="/var/lib/kubelet/pods/1acb6400-89ff-414c-9de1-1b00e376323c/volumes"
Jul 30 20:31:19.441941 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.441912    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"c9cc1f2b2a8483686552f9dd5613b2875c1dc336b97dfcf932cb98c4c4b01974"}
Jul 30 20:31:19.442263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.441968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"79935c9bdba94d08cbab8d09243a3f5f2211fd1cdff86a01cd482b4e58383550"}
Jul 30 20:31:19.442263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.441996    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"eee3aa13140a9296e8de0ad3e85e279ec0c71ca0eef39b952a6a251f34288147"}
Jul 30 20:31:19.442263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.442024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"1a1998cf4e7dbb3378d117b11668bdef2b1dad8708fd4b028f8dd7efe3d99ea9"}
Jul 30 20:31:19.442263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.442048    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"51b0372f6845a2886b66133ce06eea05b668f23907054c5167718c546a0fdc8c"}
Jul 30 20:31:19.442263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.442069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2c8f0a6-7b62-4299-94fe-395bfa911b93","Type":"ContainerStarted","Data":"bf4f18b81583088346e8018d2b7bc0d3a914a11f7660599921aa07e3192044a1"}
Jul 30 20:31:19.519434 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:19.519358    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5005516500000002 podStartE2EDuration="2.519344423s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.792773ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:31:19.516418571 +0000 UTC m=+366.770758877" watchObservedRunningTime="2026-07-30 20:31:19.519344423 +0000 UTC m=+366.773684691"
Jul 30 20:31:22.806649 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:22.806607    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:31:27.078902 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.078867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:31:27.081144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.081121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d3c8fce-3fb6-4f90-bc76-65faf3011d8a-metrics-certs\") pod \"network-metrics-daemon-txtsm\" (UID: \"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a\") " pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:31:27.155952 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.155927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nz9n\""
Jul 30 20:31:27.163477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.163460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtsm"
Jul 30 20:31:27.284155 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.284122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txtsm"]
Jul 30 20:31:27.286863 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:31:27.286836    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3c8fce_3fb6_4f90_bc76_65faf3011d8a.slice/crio-c45936c5a24c21f8f32dbb91b1ea08de2d631d7659246eac73212b108dabd8fd WatchSource:0}: Error finding container c45936c5a24c21f8f32dbb91b1ea08de2d631d7659246eac73212b108dabd8fd: Status 404 returned error can't find the container with id c45936c5a24c21f8f32dbb91b1ea08de2d631d7659246eac73212b108dabd8fd
Jul 30 20:31:27.288517 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.288500    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:31:27.469014 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:27.468929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtsm" event={"ID":"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a","Type":"ContainerStarted","Data":"c45936c5a24c21f8f32dbb91b1ea08de2d631d7659246eac73212b108dabd8fd"}
Jul 30 20:31:29.478321 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:29.478285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtsm" event={"ID":"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a","Type":"ContainerStarted","Data":"89a1d373f6437e0c19a12a8aea5402eabcf49d34da7839bf6827f271d09e4fef"}
Jul 30 20:31:29.478690 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:29.478339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtsm" event={"ID":"6d3c8fce-3fb6-4f90-bc76-65faf3011d8a","Type":"ContainerStarted","Data":"d6b24a7c0f69cf4c32f3d15f2c4f2935a2bca42092a1d656ce9aa523ffb84f8d"}
Jul 30 20:31:29.494745 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:31:29.494702    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txtsm" podStartSLOduration=375.328417836 podStartE2EDuration="6m16.494689079s" totalImagesPullingTime="1.166271243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:31:29.493874783 +0000 UTC m=+376.748215052" watchObservedRunningTime="2026-07-30 20:31:29.494689079 +0000 UTC m=+376.749029347"
Jul 30 20:32:17.805871 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:32:17.805837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:32:17.820837 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:32:17.820812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:32:18.657001 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:32:18.656973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:33:33.081958 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.081924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"]
Jul 30 20:33:33.085855 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.084917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.089625 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.089595    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 20:33:33.089888 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.089874    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 20:33:33.090150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.090131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 20:33:33.090150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.090140    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kxhrx\""
Jul 30 20:33:33.090312 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.090177    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 20:33:33.114886 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.114864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"]
Jul 30 20:33:33.151027 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.151000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.151122 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.151029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.151122 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.151058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.151122 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.151080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.151122 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.151102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkbhc\" (UniqueName: \"kubernetes.io/projected/1052640e-07b6-4db8-aa73-d5110709af2e-kube-api-access-qkbhc\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251437 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251541 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251541 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkbhc\" (UniqueName: \"kubernetes.io/projected/1052640e-07b6-4db8-aa73-d5110709af2e-kube-api-access-qkbhc\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251541 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251694 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.251873 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.251826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-manifests\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.254026 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.253981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1052640e-07b6-4db8-aa73-d5110709af2e-tmp\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.254324 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.254300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.254426 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.254372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1052640e-07b6-4db8-aa73-d5110709af2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.263143 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.263123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkbhc\" (UniqueName: \"kubernetes.io/projected/1052640e-07b6-4db8-aa73-d5110709af2e-kube-api-access-qkbhc\") pod \"opendatahub-operator-controller-manager-7fd799f58b-zmp8p\" (UID: \"1052640e-07b6-4db8-aa73-d5110709af2e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.395897 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.395847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:33.521997 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.521856    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"]
Jul 30 20:33:33.524107 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:33:33.524075    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1052640e_07b6_4db8_aa73_d5110709af2e.slice/crio-a0c121f6f7bbe9bff9822f1bed2547a4d388a5e8744c17e3637c83e7febb82c6 WatchSource:0}: Error finding container a0c121f6f7bbe9bff9822f1bed2547a4d388a5e8744c17e3637c83e7febb82c6: Status 404 returned error can't find the container with id a0c121f6f7bbe9bff9822f1bed2547a4d388a5e8744c17e3637c83e7febb82c6
Jul 30 20:33:33.890499 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:33.890464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p" event={"ID":"1052640e-07b6-4db8-aa73-d5110709af2e","Type":"ContainerStarted","Data":"a0c121f6f7bbe9bff9822f1bed2547a4d388a5e8744c17e3637c83e7febb82c6"}
Jul 30 20:33:36.902159 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:36.902130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p" event={"ID":"1052640e-07b6-4db8-aa73-d5110709af2e","Type":"ContainerStarted","Data":"08aff53c774711bf246cd0748b80ddd0bc94ea2e963922997d6a1cf073e6823f"}
Jul 30 20:33:37.907152 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:37.907125    2560 generic.go:356] "Generic (PLEG): container finished" podID="1052640e-07b6-4db8-aa73-d5110709af2e" containerID="08aff53c774711bf246cd0748b80ddd0bc94ea2e963922997d6a1cf073e6823f" exitCode=0
Jul 30 20:33:37.907437 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:37.907207    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p" event={"ID":"1052640e-07b6-4db8-aa73-d5110709af2e","Type":"ContainerDied","Data":"08aff53c774711bf246cd0748b80ddd0bc94ea2e963922997d6a1cf073e6823f"}
Jul 30 20:33:38.913895 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:38.913857    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p" event={"ID":"1052640e-07b6-4db8-aa73-d5110709af2e","Type":"ContainerStarted","Data":"3c6efd0216680991c18eeba25c5e0fc965de2f8f6b4911b4a5a6c58fdc78f8fc"}
Jul 30 20:33:38.914301 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:38.913986    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:38.940793 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:38.940740    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p" podStartSLOduration=1.291265036 podStartE2EDuration="5.940724899s" totalImagesPullingTime="3.652863355s" totalInitContainerRuntime="996.596508ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:38.938349282 +0000 UTC m=+506.192689552" watchObservedRunningTime="2026-07-30 20:33:38.940724899 +0000 UTC m=+506.195065167"
Jul 30 20:33:49.919987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:49.919960    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fd799f58b-zmp8p"
Jul 30 20:33:52.410975 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.410946    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"]
Jul 30 20:33:52.419443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.419421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.429550 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.429525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"]
Jul 30 20:33:52.431406 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.431385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 20:33:52.432131 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.432115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 20:33:52.432832 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.432698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xr27h\""
Jul 30 20:33:52.432832 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.432721    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:33:52.432832 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.432773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 20:33:52.433048 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.432936    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 20:33:52.485768 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.485743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9cc4dca8-1718-44a8-ad04-8a86c993031a-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.485878 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.485808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-988gv\" (UniqueName: \"kubernetes.io/projected/9cc4dca8-1718-44a8-ad04-8a86c993031a-kube-api-access-988gv\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.485878 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.485863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.485997 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.485976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.586500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.586463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-988gv\" (UniqueName: \"kubernetes.io/projected/9cc4dca8-1718-44a8-ad04-8a86c993031a-kube-api-access-988gv\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.586500 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.586508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.586825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.586578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.586825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.586613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9cc4dca8-1718-44a8-ad04-8a86c993031a-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.587374 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.587342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9cc4dca8-1718-44a8-ad04-8a86c993031a-manager-config\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.589132 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.589105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.589224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.589178    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9cc4dca8-1718-44a8-ad04-8a86c993031a-metrics-cert\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.609951 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.609920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-988gv\" (UniqueName: \"kubernetes.io/projected/9cc4dca8-1718-44a8-ad04-8a86c993031a-kube-api-access-988gv\") pod \"lws-controller-manager-5b6c8b8c96-vwjlv\" (UID: \"9cc4dca8-1718-44a8-ad04-8a86c993031a\") " pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.730093 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.730004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:52.916738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.916708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"]
Jul 30 20:33:52.918517 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:33:52.918484    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc4dca8_1718_44a8_ad04_8a86c993031a.slice/crio-2e536a54d1dc4f28f4f1fb060b89e2f7d78765b0a2b5ce0f7eab78f72f855a73 WatchSource:0}: Error finding container 2e536a54d1dc4f28f4f1fb060b89e2f7d78765b0a2b5ce0f7eab78f72f855a73: Status 404 returned error can't find the container with id 2e536a54d1dc4f28f4f1fb060b89e2f7d78765b0a2b5ce0f7eab78f72f855a73
Jul 30 20:33:52.963187 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:52.963149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv" event={"ID":"9cc4dca8-1718-44a8-ad04-8a86c993031a","Type":"ContainerStarted","Data":"2e536a54d1dc4f28f4f1fb060b89e2f7d78765b0a2b5ce0f7eab78f72f855a73"}
Jul 30 20:33:56.979815 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:56.979753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv" event={"ID":"9cc4dca8-1718-44a8-ad04-8a86c993031a","Type":"ContainerStarted","Data":"612fd4f5537d7fa208298943c20479e5cd371a33e14ab8cdb1ab52e0fa8482aa"}
Jul 30 20:33:56.980239 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:56.979947    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:33:56.995948 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:33:56.995903    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv" podStartSLOduration=1.968907038 podStartE2EDuration="4.995890527s" totalImagesPullingTime="3.026983489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:56.994566464 +0000 UTC m=+524.248906734" watchObservedRunningTime="2026-07-30 20:33:56.995890527 +0000 UTC m=+524.250230795"
Jul 30 20:34:01.565768 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.565735    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"]
Jul 30 20:34:01.569098 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.569082    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.573405 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.573380    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 20:34:01.573536 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.573415    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 20:34:01.574586 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.574564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 20:34:01.576338 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.576319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s7qss\""
Jul 30 20:34:01.591948 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.591920    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"]
Jul 30 20:34:01.661892 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.661857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.661896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.661920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.661944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktq6\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-kube-api-access-gktq6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.661989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.662006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662303 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.662052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662303 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.662108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.662303 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.662146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763010 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.762977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763010 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763516 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gktq6\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-kube-api-access-gktq6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763516 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763625 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763678 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.763830 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.763808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.764023 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.764004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.765389 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.765355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.765575 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.765559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.772392 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.772366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.772622 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.772600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktq6\" (UniqueName: \"kubernetes.io/projected/37c2ea8c-3fad-46af-88e1-502cd6d32bd7-kube-api-access-gktq6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b\" (UID: \"37c2ea8c-3fad-46af-88e1-502cd6d32bd7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:01.880209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:01.880134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:02.039121 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.039099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"]
Jul 30 20:34:02.040908 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:34:02.040884    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c2ea8c_3fad_46af_88e1_502cd6d32bd7.slice/crio-dbf4123b667bc7ad8aa67650b1c02bf97008902378a40bdf71e6740f0c9b995b WatchSource:0}: Error finding container dbf4123b667bc7ad8aa67650b1c02bf97008902378a40bdf71e6740f0c9b995b: Status 404 returned error can't find the container with id dbf4123b667bc7ad8aa67650b1c02bf97008902378a40bdf71e6740f0c9b995b
Jul 30 20:34:02.739800 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.739755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zc688"]
Jul 30 20:34:02.744478 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.744458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.748202 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.748185    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-27ggt\""
Jul 30 20:34:02.748292 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.748232    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 30 20:34:02.760209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.760183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zc688"]
Jul 30 20:34:02.763809 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.763774    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"]
Jul 30 20:34:02.767094 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.767072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:02.769828 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.769807    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 20:34:02.769925 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.769811    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dvjlc\""
Jul 30 20:34:02.781259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.781109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"]
Jul 30 20:34:02.873809 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.873772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtjs\" (UniqueName: \"kubernetes.io/projected/1adfa29a-0906-4b2a-acd5-57cc861e1807-kube-api-access-rgtjs\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.873931 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.873832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4g2m\" (UniqueName: \"kubernetes.io/projected/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-kube-api-access-l4g2m\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:02.873981 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.873926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1adfa29a-0906-4b2a-acd5-57cc861e1807-cert\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.873981 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.873971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:02.974917 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.974878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1adfa29a-0906-4b2a-acd5-57cc861e1807-cert\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.974917 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.974922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:02.975166 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.974952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtjs\" (UniqueName: \"kubernetes.io/projected/1adfa29a-0906-4b2a-acd5-57cc861e1807-kube-api-access-rgtjs\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.975166 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.974974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4g2m\" (UniqueName: \"kubernetes.io/projected/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-kube-api-access-l4g2m\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:02.975166 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:34:02.975066    2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 30 20:34:02.975166 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:34:02.975142    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert podName:d921ec20-dd60-48f8-a2dd-f5cf6acce3c9 nodeName:}" failed. No retries permitted until 2026-07-30 20:34:03.475120751 +0000 UTC m=+530.729461014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert") pod "llmisvc-controller-manager-777c6bd7d5-6hspb" (UID: "d921ec20-dd60-48f8-a2dd-f5cf6acce3c9") : secret "llmisvc-webhook-server-cert" not found
Jul 30 20:34:02.977433 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.977398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1adfa29a-0906-4b2a-acd5-57cc861e1807-cert\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.985575 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.985523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtjs\" (UniqueName: \"kubernetes.io/projected/1adfa29a-0906-4b2a-acd5-57cc861e1807-kube-api-access-rgtjs\") pod \"kserve-controller-manager-d6f4b65b8-zc688\" (UID: \"1adfa29a-0906-4b2a-acd5-57cc861e1807\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:02.987329 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:02.987301    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4g2m\" (UniqueName: \"kubernetes.io/projected/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-kube-api-access-l4g2m\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:03.002503 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.002441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b" event={"ID":"37c2ea8c-3fad-46af-88e1-502cd6d32bd7","Type":"ContainerStarted","Data":"dbf4123b667bc7ad8aa67650b1c02bf97008902378a40bdf71e6740f0c9b995b"}
Jul 30 20:34:03.054599 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.054578    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:03.219544 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.219484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zc688"]
Jul 30 20:34:03.223883 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:34:03.223855    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adfa29a_0906_4b2a_acd5_57cc861e1807.slice/crio-d9d1a1fa0461aa8c7ddb969387fb4af5e6a1afcc7dc7cfbd1b71e489fc077618 WatchSource:0}: Error finding container d9d1a1fa0461aa8c7ddb969387fb4af5e6a1afcc7dc7cfbd1b71e489fc077618: Status 404 returned error can't find the container with id d9d1a1fa0461aa8c7ddb969387fb4af5e6a1afcc7dc7cfbd1b71e489fc077618
Jul 30 20:34:03.479053 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.479020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:03.481452 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.481424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d921ec20-dd60-48f8-a2dd-f5cf6acce3c9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6hspb\" (UID: \"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:03.683401 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.683373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:03.826670 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:03.826643    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"]
Jul 30 20:34:03.828619 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:34:03.828588    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd921ec20_dd60_48f8_a2dd_f5cf6acce3c9.slice/crio-5c0bdba1f7d9155f6344e9d814e3dd455551705646fef59edfc7feb46c5bf9d1 WatchSource:0}: Error finding container 5c0bdba1f7d9155f6344e9d814e3dd455551705646fef59edfc7feb46c5bf9d1: Status 404 returned error can't find the container with id 5c0bdba1f7d9155f6344e9d814e3dd455551705646fef59edfc7feb46c5bf9d1
Jul 30 20:34:04.008483 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:04.008395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb" event={"ID":"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9","Type":"ContainerStarted","Data":"5c0bdba1f7d9155f6344e9d814e3dd455551705646fef59edfc7feb46c5bf9d1"}
Jul 30 20:34:04.009840 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:04.009811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688" event={"ID":"1adfa29a-0906-4b2a-acd5-57cc861e1807","Type":"ContainerStarted","Data":"d9d1a1fa0461aa8c7ddb969387fb4af5e6a1afcc7dc7cfbd1b71e489fc077618"}
Jul 30 20:34:05.723388 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:05.723340    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:34:05.723649 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:05.723442    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:34:05.723649 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:05.723488    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:34:06.023450 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.023306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688" event={"ID":"1adfa29a-0906-4b2a-acd5-57cc861e1807","Type":"ContainerStarted","Data":"1d5ad13051f6a2dbf49578aff1063ea53b1446b44bc5777e484e31e8f71d8f9c"}
Jul 30 20:34:06.023861 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.023805    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:06.025564 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.025537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b" event={"ID":"37c2ea8c-3fad-46af-88e1-502cd6d32bd7","Type":"ContainerStarted","Data":"f340a676bf3b23bfe91ae3df6f8f182f27968eaa05030cb45a950e4081f31683"}
Jul 30 20:34:06.041915 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.041867    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688" podStartSLOduration=1.543981643 podStartE2EDuration="4.041851428s" totalImagesPullingTime="2.497869785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:06.041154199 +0000 UTC m=+533.295494468" watchObservedRunningTime="2026-07-30 20:34:06.041851428 +0000 UTC m=+533.296191697"
Jul 30 20:34:06.062533 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.062451    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b" podStartSLOduration=1.382171869 podStartE2EDuration="5.062432684s" totalImagesPullingTime="3.680260815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:06.062125299 +0000 UTC m=+533.316465569" watchObservedRunningTime="2026-07-30 20:34:06.062432684 +0000 UTC m=+533.316772954"
Jul 30 20:34:06.881219 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.881183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:06.886261 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:06.886234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:07.030523 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:07.030479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:07.031441 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:07.031417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b"
Jul 30 20:34:07.986723 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:07.986693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b6c8b8c96-vwjlv"
Jul 30 20:34:09.040208 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:09.040169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb" event={"ID":"d921ec20-dd60-48f8-a2dd-f5cf6acce3c9","Type":"ContainerStarted","Data":"ce98b83b6ac6c0df9e6cdf8997f5cd28f996a285153d07f6fde74f75eae61ba1"}
Jul 30 20:34:09.062144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:09.062100    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb" podStartSLOduration=2.6898588930000003 podStartE2EDuration="7.062085488s" totalImagesPullingTime="4.372226595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:09.06090708 +0000 UTC m=+536.315247349" watchObservedRunningTime="2026-07-30 20:34:09.062085488 +0000 UTC m=+536.316425757"
Jul 30 20:34:10.044591 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:10.044548    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:34:38.041113 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:38.041084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zc688"
Jul 30 20:34:41.050257 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:34:41.050227    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6hspb"
Jul 30 20:35:23.779985 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.779915    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"]
Jul 30 20:35:23.781979 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.781964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:23.785048 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.785029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gkg5x\""
Jul 30 20:35:23.785167 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.785030    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 20:35:23.786038 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.786020    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 20:35:23.792403 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.792382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"]
Jul 30 20:35:23.869076 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.869055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lsf\" (UniqueName: \"kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf\") pod \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" (UID: \"33c629ce-831e-42bf-a5a0-f620594723d2\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:23.970018 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.969994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lsf\" (UniqueName: \"kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf\") pod \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" (UID: \"33c629ce-831e-42bf-a5a0-f620594723d2\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:23.986733 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:23.986710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lsf\" (UniqueName: \"kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf\") pod \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" (UID: \"33c629ce-831e-42bf-a5a0-f620594723d2\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:24.092565 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:24.092545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:24.211495 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:24.211467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"]
Jul 30 20:35:24.213986 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:35:24.213956    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c629ce_831e_42bf_a5a0_f620594723d2.slice/crio-26d72bdfefdec5e357909be357c8aacec153c711e1e02e1e477f548a0c9fedd1 WatchSource:0}: Error finding container 26d72bdfefdec5e357909be357c8aacec153c711e1e02e1e477f548a0c9fedd1: Status 404 returned error can't find the container with id 26d72bdfefdec5e357909be357c8aacec153c711e1e02e1e477f548a0c9fedd1
Jul 30 20:35:24.313342 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:24.313313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r" event={"ID":"33c629ce-831e-42bf-a5a0-f620594723d2","Type":"ContainerStarted","Data":"26d72bdfefdec5e357909be357c8aacec153c711e1e02e1e477f548a0c9fedd1"}
Jul 30 20:35:27.327028 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:27.326997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r" event={"ID":"33c629ce-831e-42bf-a5a0-f620594723d2","Type":"ContainerStarted","Data":"e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912"}
Jul 30 20:35:27.327438 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:27.327060    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:27.345150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:27.345108    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r" podStartSLOduration=1.5772307639999998 podStartE2EDuration="4.345087846s" totalImagesPullingTime="2.767857082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:27.344300218 +0000 UTC m=+614.598640487" watchObservedRunningTime="2026-07-30 20:35:27.345087846 +0000 UTC m=+614.599428116"
Jul 30 20:35:38.334612 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:38.334534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:39.367425 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.367393    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"]
Jul 30 20:35:39.367903 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.367561    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" containerName="manager" containerID="cri-o://e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912" gracePeriod=2
Jul 30 20:35:39.388183 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.388152    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"]
Jul 30 20:35:39.407087 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:39.407053    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"33c629ce-831e-42bf-a5a0-f620594723d2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-f4l5r\": pods \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:39.421999 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.421971    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"]
Jul 30 20:35:39.422414 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.422397    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" containerName="manager"
Jul 30 20:35:39.422461 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.422420    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" containerName="manager"
Jul 30 20:35:39.422529 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.422518    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" containerName="manager"
Jul 30 20:35:39.425714 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.425691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:39.428170 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:39.428142    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" is forbidden: User \"system:node:ip-10-0-139-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-183.ec2.internal' and this object" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:39.451379 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.451357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"]
Jul 30 20:35:39.582685 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.582656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqvgw\" (UniqueName: \"kubernetes.io/projected/b43f0d38-c208-43a4-8955-4896c4720a72-kube-api-access-fqvgw\") pod \"limitador-operator-controller-manager-6c549b6d85-77gnd\" (UID: \"b43f0d38-c208-43a4-8955-4896c4720a72\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:39.606456 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.606434    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:39.608667 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:39.608644    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" is forbidden: User \"system:node:ip-10-0-139-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-183.ec2.internal' and this object" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:39.684146 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.684078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqvgw\" (UniqueName: \"kubernetes.io/projected/b43f0d38-c208-43a4-8955-4896c4720a72-kube-api-access-fqvgw\") pod \"limitador-operator-controller-manager-6c549b6d85-77gnd\" (UID: \"b43f0d38-c208-43a4-8955-4896c4720a72\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:39.692564 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.692536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqvgw\" (UniqueName: \"kubernetes.io/projected/b43f0d38-c208-43a4-8955-4896c4720a72-kube-api-access-fqvgw\") pod \"limitador-operator-controller-manager-6c549b6d85-77gnd\" (UID: \"b43f0d38-c208-43a4-8955-4896c4720a72\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:39.738502 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.738482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:39.784536 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.784506    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9lsf\" (UniqueName: \"kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf\") pod \"33c629ce-831e-42bf-a5a0-f620594723d2\" (UID: \"33c629ce-831e-42bf-a5a0-f620594723d2\") "
Jul 30 20:35:39.787246 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.787204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf" (OuterVolumeSpecName: "kube-api-access-k9lsf") pod "33c629ce-831e-42bf-a5a0-f620594723d2" (UID: "33c629ce-831e-42bf-a5a0-f620594723d2"). InnerVolumeSpecName "kube-api-access-k9lsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:35:39.860680 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.860656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"]
Jul 30 20:35:39.862925 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:35:39.862902    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43f0d38_c208_43a4_8955_4896c4720a72.slice/crio-82384e1cc246447576d8eea345797a2097b838ab5e56b57ee84c63f334205a48 WatchSource:0}: Error finding container 82384e1cc246447576d8eea345797a2097b838ab5e56b57ee84c63f334205a48: Status 404 returned error can't find the container with id 82384e1cc246447576d8eea345797a2097b838ab5e56b57ee84c63f334205a48
Jul 30 20:35:39.885531 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:39.885510    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9lsf\" (UniqueName: \"kubernetes.io/projected/33c629ce-831e-42bf-a5a0-f620594723d2-kube-api-access-k9lsf\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:35:40.381825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.381775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd" event={"ID":"b43f0d38-c208-43a4-8955-4896c4720a72","Type":"ContainerStarted","Data":"055786402b10f00dbbe0efc9385fde25cd1c55af21c3284b3769e41379601704"}
Jul 30 20:35:40.382260 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.381849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd" event={"ID":"b43f0d38-c208-43a4-8955-4896c4720a72","Type":"ContainerStarted","Data":"82384e1cc246447576d8eea345797a2097b838ab5e56b57ee84c63f334205a48"}
Jul 30 20:35:40.382260 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.381902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:35:40.383239 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.383212    2560 generic.go:356] "Generic (PLEG): container finished" podID="33c629ce-831e-42bf-a5a0-f620594723d2" containerID="e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912" exitCode=0
Jul 30 20:35:40.383353 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.383258    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:40.383353 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.383270    2560 scope.go:117] "RemoveContainer" containerID="e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912"
Jul 30 20:35:40.384208 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:40.384076    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" is forbidden: User \"system:node:ip-10-0-139-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-183.ec2.internal' and this object" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:40.391051 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.391036    2560 scope.go:117] "RemoveContainer" containerID="e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912"
Jul 30 20:35:40.391352 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:40.391329    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912\": container with ID starting with e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912 not found: ID does not exist" containerID="e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912"
Jul 30 20:35:40.391416 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.391357    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912"} err="failed to get container status \"e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912\": rpc error: code = NotFound desc = could not find container \"e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912\": container with ID starting with e9677cd429f36ad3bf14b093e0c647b61a0d04821fe5d902b4ec9cdda2f38912 not found: ID does not exist"
Jul 30 20:35:40.401549 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:40.401511    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd" podStartSLOduration=1.401500078 podStartE2EDuration="1.401500078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:40.400771728 +0000 UTC m=+627.655111997" watchObservedRunningTime="2026-07-30 20:35:40.401500078 +0000 UTC m=+627.655840345"
Jul 30 20:35:40.402802 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:35:40.402765    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4l5r\" is forbidden: User \"system:node:ip-10-0-139-183.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-183.ec2.internal' and this object" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4l5r"
Jul 30 20:35:41.256430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:41.256399    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c629ce-831e-42bf-a5a0-f620594723d2" path="/var/lib/kubelet/pods/33c629ce-831e-42bf-a5a0-f620594723d2/volumes"
Jul 30 20:35:51.392031 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:35:51.391997    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-77gnd"
Jul 30 20:36:07.924645 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:07.924607    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"]
Jul 30 20:36:07.927691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:07.927669    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:07.930145 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:07.930123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5zbtx\""
Jul 30 20:36:07.942377 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:07.942347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"]
Jul 30 20:36:08.018828 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c178b4f-3134-429c-b8b5-1747d4de03a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvd5m\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-kube-api-access-bvd5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.018984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019254 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.019059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.019254 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.019114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.119756 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.119756 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c178b4f-3134-429c-b8b5-1747d4de03a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvd5m\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-kube-api-access-bvd5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120004 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.119975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120340 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.120191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120340 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.120253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120340 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.120313    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120521 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.120499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.120612 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.120591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c178b4f-3134-429c-b8b5-1747d4de03a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.122598 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.122575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.122723 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.122708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.128543 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.128518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.128656 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.128609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvd5m\" (UniqueName: \"kubernetes.io/projected/2c178b4f-3134-429c-b8b5-1747d4de03a4-kube-api-access-bvd5m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w2tgm\" (UID: \"2c178b4f-3134-429c-b8b5-1747d4de03a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.237749 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.237682    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:08.363631 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.363608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"]
Jul 30 20:36:08.366183 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:36:08.366146    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c178b4f_3134_429c_b8b5_1747d4de03a4.slice/crio-8293ac060a4364c0360dae97262c55424252b93a58a9a95781fc2bd12c051b17 WatchSource:0}: Error finding container 8293ac060a4364c0360dae97262c55424252b93a58a9a95781fc2bd12c051b17: Status 404 returned error can't find the container with id 8293ac060a4364c0360dae97262c55424252b93a58a9a95781fc2bd12c051b17
Jul 30 20:36:08.368159 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.368118    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:36:08.368230 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.368205    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:36:08.368269 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.368248    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:36:08.503508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.503416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" event={"ID":"2c178b4f-3134-429c-b8b5-1747d4de03a4","Type":"ContainerStarted","Data":"56dc4ed6baa64df8d4c3fa69e01c31d401a68b5a95052e4258a032048a516099"}
Jul 30 20:36:08.503669 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.503527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" event={"ID":"2c178b4f-3134-429c-b8b5-1747d4de03a4","Type":"ContainerStarted","Data":"8293ac060a4364c0360dae97262c55424252b93a58a9a95781fc2bd12c051b17"}
Jul 30 20:36:08.528924 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:08.528874    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podStartSLOduration=1.528859034 podStartE2EDuration="1.528859034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:08.526644317 +0000 UTC m=+655.780984585" watchObservedRunningTime="2026-07-30 20:36:08.528859034 +0000 UTC m=+655.783199302"
Jul 30 20:36:09.237950 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:09.237910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:09.242254 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:09.242228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:09.508095 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:09.508017    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:09.508892 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:09.508872    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:36:45.394586 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.394552    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:36:45.397724 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.397703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.400817 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.400799    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6mz44\""
Jul 30 20:36:45.401330 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.401314    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 20:36:45.401823 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.401796    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 20:36:45.411287 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.411263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:36:45.519984 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.519951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kw2\" (UniqueName: \"kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.520142 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.519994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.620812 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.620763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kw2\" (UniqueName: \"kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.620946 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.620837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.623117 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.623095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.632959 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.632935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kw2\" (UniqueName: \"kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2\") pod \"maas-controller-69fc8bd89f-jvhdc\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") " pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.707949 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.707893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:45.828871 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.828826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:36:45.831122 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:36:45.831088    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b40d550_c848_4548_a31c_34534bc13450.slice/crio-d62fb46cfb0465be15b4e23303756074f4f1cb054e2c49d615aa1c1db2ea14f2 WatchSource:0}: Error finding container d62fb46cfb0465be15b4e23303756074f4f1cb054e2c49d615aa1c1db2ea14f2: Status 404 returned error can't find the container with id d62fb46cfb0465be15b4e23303756074f4f1cb054e2c49d615aa1c1db2ea14f2
Jul 30 20:36:45.832288 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:45.832271    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:36:46.658354 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:46.658239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" event={"ID":"1b40d550-c848-4548-a31c-34534bc13450","Type":"ContainerStarted","Data":"d62fb46cfb0465be15b4e23303756074f4f1cb054e2c49d615aa1c1db2ea14f2"}
Jul 30 20:36:48.667763 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:48.667727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" event={"ID":"1b40d550-c848-4548-a31c-34534bc13450","Type":"ContainerStarted","Data":"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"}
Jul 30 20:36:48.668158 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:48.667837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:48.688111 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:48.688062    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" podStartSLOduration=1.374640059 podStartE2EDuration="3.688046764s" totalImagesPullingTime="2.313406705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:48.686225631 +0000 UTC m=+695.940565900" watchObservedRunningTime="2026-07-30 20:36:48.688046764 +0000 UTC m=+695.942387032"
Jul 30 20:36:59.674432 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:59.674401    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:36:59.996976 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:59.996896    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:36:59.997125 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:36:59.997066    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" podUID="1b40d550-c848-4548-a31c-34534bc13450" containerName="manager" containerID="cri-o://397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e" gracePeriod=30
Jul 30 20:37:00.243518 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.243491    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:37:00.338251 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.338211    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert\") pod \"1b40d550-c848-4548-a31c-34534bc13450\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") "
Jul 30 20:37:00.338417 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.338284    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2kw2\" (UniqueName: \"kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2\") pod \"1b40d550-c848-4548-a31c-34534bc13450\" (UID: \"1b40d550-c848-4548-a31c-34534bc13450\") "
Jul 30 20:37:00.340545 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.340511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2" (OuterVolumeSpecName: "kube-api-access-h2kw2") pod "1b40d550-c848-4548-a31c-34534bc13450" (UID: "1b40d550-c848-4548-a31c-34534bc13450"). InnerVolumeSpecName "kube-api-access-h2kw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:00.340674 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.340575    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1b40d550-c848-4548-a31c-34534bc13450" (UID: "1b40d550-c848-4548-a31c-34534bc13450"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:37:00.439410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.439380    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b40d550-c848-4548-a31c-34534bc13450-webhook-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:37:00.439410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.439406    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2kw2\" (UniqueName: \"kubernetes.io/projected/1b40d550-c848-4548-a31c-34534bc13450-kube-api-access-h2kw2\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:37:00.717262 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.717168    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b40d550-c848-4548-a31c-34534bc13450" containerID="397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e" exitCode=0
Jul 30 20:37:00.717262 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.717214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" event={"ID":"1b40d550-c848-4548-a31c-34534bc13450","Type":"ContainerDied","Data":"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"}
Jul 30 20:37:00.717262 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.717230    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc"
Jul 30 20:37:00.717771 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.717297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc8bd89f-jvhdc" event={"ID":"1b40d550-c848-4548-a31c-34534bc13450","Type":"ContainerDied","Data":"d62fb46cfb0465be15b4e23303756074f4f1cb054e2c49d615aa1c1db2ea14f2"}
Jul 30 20:37:00.717771 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.717327    2560 scope.go:117] "RemoveContainer" containerID="397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"
Jul 30 20:37:00.725620 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.725600    2560 scope.go:117] "RemoveContainer" containerID="397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"
Jul 30 20:37:00.725908 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:37:00.725888    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e\": container with ID starting with 397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e not found: ID does not exist" containerID="397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"
Jul 30 20:37:00.725963 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.725916    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e"} err="failed to get container status \"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e\": rpc error: code = NotFound desc = could not find container \"397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e\": container with ID starting with 397a3c6415d76891530fe4dd0e8fe245a96b13d4edf8401135d2650481ceca6e not found: ID does not exist"
Jul 30 20:37:00.737701 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.737676    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:37:00.741917 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:00.741894    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69fc8bd89f-jvhdc"]
Jul 30 20:37:01.256508 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:01.256475    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b40d550-c848-4548-a31c-34534bc13450" path="/var/lib/kubelet/pods/1b40d550-c848-4548-a31c-34534bc13450/volumes"
Jul 30 20:37:35.857463 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.857431    2560 generic.go:356] "Generic (PLEG): container finished" podID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerID="56dc4ed6baa64df8d4c3fa69e01c31d401a68b5a95052e4258a032048a516099" exitCode=0
Jul 30 20:37:35.857894 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.857509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" event={"ID":"2c178b4f-3134-429c-b8b5-1747d4de03a4","Type":"ContainerDied","Data":"56dc4ed6baa64df8d4c3fa69e01c31d401a68b5a95052e4258a032048a516099"}
Jul 30 20:37:35.857894 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.857879    2560 scope.go:117] "RemoveContainer" containerID="56dc4ed6baa64df8d4c3fa69e01c31d401a68b5a95052e4258a032048a516099"
Jul 30 20:37:35.858747 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.858719    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:37:35.858852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.858806    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:37:35.858852 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:35.858835    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:37:36.863187 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:36.863150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" event={"ID":"2c178b4f-3134-429c-b8b5-1747d4de03a4","Type":"ContainerStarted","Data":"f068e06fdbdb0b207dd2cd152a177bc2629d3650f244c98e4b7741f744802ed3"}
Jul 30 20:37:37.238603 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:37.238520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:37:37.239622 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:37.239590    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w2tgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 30 20:37:37.239747 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:37.239642    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podUID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 30 20:37:38.238632 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:38.238594    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w2tgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 30 20:37:38.239039 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:38.238651    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podUID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 30 20:37:39.239061 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:39.239027    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w2tgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 30 20:37:39.239440 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:39.239089    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podUID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 30 20:37:39.508274 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:39.508181    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:37:40.238629 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:40.238586    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w2tgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 30 20:37:40.238858 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:40.238647    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podUID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 30 20:37:41.238373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:41.238334    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w2tgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 30 20:37:41.238733 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:41.238401    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm" podUID="2c178b4f-3134-429c-b8b5-1747d4de03a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 30 20:37:42.241718 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:42.241689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:37:42.242773 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:37:42.242752    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w2tgm"
Jul 30 20:38:03.542837 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.542806    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"]
Jul 30 20:38:03.543413 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.543099    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b40d550-c848-4548-a31c-34534bc13450" containerName="manager"
Jul 30 20:38:03.543413 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.543109    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b40d550-c848-4548-a31c-34534bc13450" containerName="manager"
Jul 30 20:38:03.543413 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.543157    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b40d550-c848-4548-a31c-34534bc13450" containerName="manager"
Jul 30 20:38:03.546262 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.546239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.548977 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.548954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 20:38:03.549096 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.548990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6wjc2\""
Jul 30 20:38:03.549908 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.549892    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 30 20:38:03.549972 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.549924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 20:38:03.555579 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.555560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"]
Jul 30 20:38:03.623995 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.623966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.624123 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.624022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.624123 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.624076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.624123 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.624097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz7p4\" (UniqueName: \"kubernetes.io/projected/f4fdaab4-d6f6-4555-b229-0199d9e1d821-kube-api-access-pz7p4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.624268 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.624169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.624268 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.624234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz7p4\" (UniqueName: \"kubernetes.io/projected/f4fdaab4-d6f6-4555-b229-0199d9e1d821-kube-api-access-pz7p4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725417 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725484 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725550 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.725616 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.725597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.727302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.727280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4fdaab4-d6f6-4555-b229-0199d9e1d821-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.727499 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.727481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4fdaab4-d6f6-4555-b229-0199d9e1d821-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.732888 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.732868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz7p4\" (UniqueName: \"kubernetes.io/projected/f4fdaab4-d6f6-4555-b229-0199d9e1d821-kube-api-access-pz7p4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d9zgn\" (UID: \"f4fdaab4-d6f6-4555-b229-0199d9e1d821\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.856608 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.856583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:03.979957 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:03.979931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"]
Jul 30 20:38:03.982507 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:38:03.982479    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fdaab4_d6f6_4555_b229_0199d9e1d821.slice/crio-c1f625188399b470431caa1a3d0b2dd7283d79ecef982d7dffefb9a082f7c39d WatchSource:0}: Error finding container c1f625188399b470431caa1a3d0b2dd7283d79ecef982d7dffefb9a082f7c39d: Status 404 returned error can't find the container with id c1f625188399b470431caa1a3d0b2dd7283d79ecef982d7dffefb9a082f7c39d
Jul 30 20:38:04.978292 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:04.978259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn" event={"ID":"f4fdaab4-d6f6-4555-b229-0199d9e1d821","Type":"ContainerStarted","Data":"c1f625188399b470431caa1a3d0b2dd7283d79ecef982d7dffefb9a082f7c39d"}
Jul 30 20:38:05.983240 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:05.983203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn" event={"ID":"f4fdaab4-d6f6-4555-b229-0199d9e1d821","Type":"ContainerStarted","Data":"33540488af5edfd1c8eca500695db2b86fd6dbb64e22f56ea774a6dbec0ba4a0"}
Jul 30 20:38:06.000359 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:06.000316    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn" podStartSLOduration=2.05138153 podStartE2EDuration="3.00030203s" totalImagesPullingTime="948.9205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:38:05.998519712 +0000 UTC m=+773.252860006" watchObservedRunningTime="2026-07-30 20:38:06.00030203 +0000 UTC m=+773.254642330"
Jul 30 20:38:13.857562 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:13.857526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:13.857988 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:13.857589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:13.869142 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:13.869120    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:14.024534 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:14.024509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d9zgn"
Jul 30 20:38:26.147822 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.147765    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"]
Jul 30 20:38:26.151209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.151190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.153728 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.153706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 20:38:26.161152 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.161134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"]
Jul 30 20:38:26.188793 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.188754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.188901 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.188817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.188979 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.188926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c22b790-12b7-40e0-89a4-cd243447a641-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.188979 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.188968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.189088 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.189022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4gxj\" (UniqueName: \"kubernetes.io/projected/1c22b790-12b7-40e0-89a4-cd243447a641-kube-api-access-t4gxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.189088 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.189068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290063 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290164 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c22b790-12b7-40e0-89a4-cd243447a641-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290164 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290164 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4gxj\" (UniqueName: \"kubernetes.io/projected/1c22b790-12b7-40e0-89a4-cd243447a641-kube-api-access-t4gxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290164 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290424 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290492 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290492 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.290634 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.290527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.292424 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.292401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c22b790-12b7-40e0-89a4-cd243447a641-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.292646 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.292631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c22b790-12b7-40e0-89a4-cd243447a641-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.298611 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.298591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4gxj\" (UniqueName: \"kubernetes.io/projected/1c22b790-12b7-40e0-89a4-cd243447a641-kube-api-access-t4gxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g\" (UID: \"1c22b790-12b7-40e0-89a4-cd243447a641\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.461870 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.461806    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:26.584970 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:26.584948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"]
Jul 30 20:38:26.587142 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:38:26.587101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c22b790_12b7_40e0_89a4_cd243447a641.slice/crio-d0acd718cf2f37eaf4d36546a8d20bc8003092b8617f3c9d7f9c5ffabf739b10 WatchSource:0}: Error finding container d0acd718cf2f37eaf4d36546a8d20bc8003092b8617f3c9d7f9c5ffabf739b10: Status 404 returned error can't find the container with id d0acd718cf2f37eaf4d36546a8d20bc8003092b8617f3c9d7f9c5ffabf739b10
Jul 30 20:38:27.066540 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:27.066501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g" event={"ID":"1c22b790-12b7-40e0-89a4-cd243447a641","Type":"ContainerStarted","Data":"abbf7b0148dcff9f3cc676d7d3db1808fdc5a27e9911b5de5eb72edb9bd06910"}
Jul 30 20:38:27.066697 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:27.066565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g" event={"ID":"1c22b790-12b7-40e0-89a4-cd243447a641","Type":"ContainerStarted","Data":"d0acd718cf2f37eaf4d36546a8d20bc8003092b8617f3c9d7f9c5ffabf739b10"}
Jul 30 20:38:27.082612 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:27.082573    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g" podStartSLOduration=0.90136483 podStartE2EDuration="1.082556548s" totalImagesPullingTime="181.191718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:38:27.081677748 +0000 UTC m=+794.336018017" watchObservedRunningTime="2026-07-30 20:38:27.082556548 +0000 UTC m=+794.336896819"
Jul 30 20:38:36.462981 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:36.462896    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:36.463536 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:36.462977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:36.474909 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:36.474885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:38:37.119533 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:38:37.119505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g"
Jul 30 20:41:48.987446 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:48.987363    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:41:48.990462 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:48.990441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:48.993115 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:48.993093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 20:41:48.994067 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:48.994051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6mz44\""
Jul 30 20:41:48.994439 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:48.994415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 20:41:49.001829 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.001810    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:41:49.108215 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.108188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csb2t\" (UniqueName: \"kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.108313 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.108286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.209457 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.209433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.209550 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.209473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csb2t\" (UniqueName: \"kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.211712 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.211693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.218804 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.218762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csb2t\" (UniqueName: \"kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t\") pod \"maas-controller-55bc447b6-c82f6\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") " pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.300736 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.300686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:49.425013 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.424991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:41:49.426754 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:41:49.426724    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7f7ad3_d24d_4ce3_a7f5_e70dbcfc7639.slice/crio-79669eb62a4518df466f69f5e28e5c57666ba5c50771a58ef20fc90f07371dae WatchSource:0}: Error finding container 79669eb62a4518df466f69f5e28e5c57666ba5c50771a58ef20fc90f07371dae: Status 404 returned error can't find the container with id 79669eb62a4518df466f69f5e28e5c57666ba5c50771a58ef20fc90f07371dae
Jul 30 20:41:49.428093 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.428074    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:41:49.875463 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:49.875435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-c82f6" event={"ID":"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639","Type":"ContainerStarted","Data":"79669eb62a4518df466f69f5e28e5c57666ba5c50771a58ef20fc90f07371dae"}
Jul 30 20:41:50.881652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:50.881615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-c82f6" event={"ID":"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639","Type":"ContainerStarted","Data":"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"}
Jul 30 20:41:50.882065 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:50.881716    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:41:50.900684 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:41:50.900626    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55bc447b6-c82f6" podStartSLOduration=2.430746616 podStartE2EDuration="2.900609085s" totalImagesPullingTime="469.862469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:41:50.898990172 +0000 UTC m=+998.153330442" watchObservedRunningTime="2026-07-30 20:41:50.900609085 +0000 UTC m=+998.154949379"
Jul 30 20:42:01.888278 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:01.888245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:42:06.548254 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.548217    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:42:06.548668 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.548415    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55bc447b6-c82f6" podUID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" containerName="manager" containerID="cri-o://307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288" gracePeriod=30
Jul 30 20:42:06.789224 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.789202    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:42:06.855813 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.855766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csb2t\" (UniqueName: \"kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t\") pod \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") "
Jul 30 20:42:06.855980 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.855836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert\") pod \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\" (UID: \"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639\") "
Jul 30 20:42:06.857671 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.857645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t" (OuterVolumeSpecName: "kube-api-access-csb2t") pod "de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" (UID: "de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639"). InnerVolumeSpecName "kube-api-access-csb2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:42:06.857807 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.857761    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" (UID: "de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:42:06.951253 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.951225    2560 generic.go:356] "Generic (PLEG): container finished" podID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" containerID="307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288" exitCode=0
Jul 30 20:42:06.951386 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.951262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-c82f6"
Jul 30 20:42:06.951386 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.951313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-c82f6" event={"ID":"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639","Type":"ContainerDied","Data":"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"}
Jul 30 20:42:06.951386 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.951370    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-c82f6" event={"ID":"de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639","Type":"ContainerDied","Data":"79669eb62a4518df466f69f5e28e5c57666ba5c50771a58ef20fc90f07371dae"}
Jul 30 20:42:06.951541 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.951398    2560 scope.go:117] "RemoveContainer" containerID="307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"
Jul 30 20:42:06.956654 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.956629    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csb2t\" (UniqueName: \"kubernetes.io/projected/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-kube-api-access-csb2t\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:42:06.956737 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.956656    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639-webhook-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:42:06.959410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.959394    2560 scope.go:117] "RemoveContainer" containerID="307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"
Jul 30 20:42:06.959651 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:42:06.959632    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288\": container with ID starting with 307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288 not found: ID does not exist" containerID="307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"
Jul 30 20:42:06.959711 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.959658    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288"} err="failed to get container status \"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288\": rpc error: code = NotFound desc = could not find container \"307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288\": container with ID starting with 307dada733badfe39949267963b99db65545ac7782c63301ff0803cf1e046288 not found: ID does not exist"
Jul 30 20:42:06.971612 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.971589    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:42:06.975011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:06.974993    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55bc447b6-c82f6"]
Jul 30 20:42:07.256676 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.256605    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" path="/var/lib/kubelet/pods/de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639/volumes"
Jul 30 20:42:07.818149 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.818121    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55bc447b6-qk2qs"]
Jul 30 20:42:07.818580 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.818561    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" containerName="manager"
Jul 30 20:42:07.818652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.818583    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" containerName="manager"
Jul 30 20:42:07.818707 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.818663    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de7f7ad3-d24d-4ce3-a7f5-e70dbcfc7639" containerName="manager"
Jul 30 20:42:07.822812 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.822769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.826477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.826458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 20:42:07.826477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.826481    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 20:42:07.826619 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.826552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6mz44\""
Jul 30 20:42:07.831337 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.831316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bc447b6-qk2qs"]
Jul 30 20:42:07.863314 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.863287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbc1dba9-df29-4be1-aca4-d8988f3239a1-webhook-cert\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.863434 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.863325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwdm\" (UniqueName: \"kubernetes.io/projected/dbc1dba9-df29-4be1-aca4-d8988f3239a1-kube-api-access-5bwdm\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.963721 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.963685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwdm\" (UniqueName: \"kubernetes.io/projected/dbc1dba9-df29-4be1-aca4-d8988f3239a1-kube-api-access-5bwdm\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.963902 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.963806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbc1dba9-df29-4be1-aca4-d8988f3239a1-webhook-cert\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.966100 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.966082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbc1dba9-df29-4be1-aca4-d8988f3239a1-webhook-cert\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:07.971921 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:07.971897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwdm\" (UniqueName: \"kubernetes.io/projected/dbc1dba9-df29-4be1-aca4-d8988f3239a1-kube-api-access-5bwdm\") pod \"maas-controller-55bc447b6-qk2qs\" (UID: \"dbc1dba9-df29-4be1-aca4-d8988f3239a1\") " pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:08.134209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.134123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:08.261955 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.261931    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55bc447b6-qk2qs"]
Jul 30 20:42:08.264182 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:42:08.264149    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc1dba9_df29_4be1_aca4_d8988f3239a1.slice/crio-a53be31a3d2026ee192bbd46884967aaee17fecee3c27bd398874b9a42f4b43b WatchSource:0}: Error finding container a53be31a3d2026ee192bbd46884967aaee17fecee3c27bd398874b9a42f4b43b: Status 404 returned error can't find the container with id a53be31a3d2026ee192bbd46884967aaee17fecee3c27bd398874b9a42f4b43b
Jul 30 20:42:08.967889 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.967798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-qk2qs" event={"ID":"dbc1dba9-df29-4be1-aca4-d8988f3239a1","Type":"ContainerStarted","Data":"693bd82657976d5bd3bf5c4e2a8c4641c0356e26bd99e0ebd4c370a9af577b1a"}
Jul 30 20:42:08.967889 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.967856    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55bc447b6-qk2qs" event={"ID":"dbc1dba9-df29-4be1-aca4-d8988f3239a1","Type":"ContainerStarted","Data":"a53be31a3d2026ee192bbd46884967aaee17fecee3c27bd398874b9a42f4b43b"}
Jul 30 20:42:08.967889 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.967880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:42:08.984961 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:08.984913    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55bc447b6-qk2qs" podStartSLOduration=1.547205034 podStartE2EDuration="1.984897139s" totalImagesPullingTime="437.692105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:42:08.98335289 +0000 UTC m=+1016.237693158" watchObservedRunningTime="2026-07-30 20:42:08.984897139 +0000 UTC m=+1016.239237437"
Jul 30 20:42:19.974466 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:42:19.974436    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55bc447b6-qk2qs"
Jul 30 20:57:41.101825 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.101794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:57:41.105016 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.104994    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.108725 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.108706    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-83e97498-openshift-default-dockercfg-4kvfn\""
Jul 30 20:57:41.128954 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.128927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:57:41.224121 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224121 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw546\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224319 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224319 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224319 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.224430 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.224395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325192 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw546\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325352 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325660 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325660 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325760 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.325958 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.325854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.326144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.326103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.327644 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.327620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.327813 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.327798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.333196 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.333176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.333734 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.333709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw546\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546\") pod \"e2e-ait-83e97498-openshift-default-778457fdb-qhpmg\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") " pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.415074 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.415018    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:41.545639 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.545615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:57:41.547280 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:57:41.547251    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8e8e80_d27b_4d6c_94ef_7c66d9ea4ff9.slice/crio-9e79fd6448d9a0746968594a9fa2d247286bf1b7d5b237e61efb7b88535f76de WatchSource:0}: Error finding container 9e79fd6448d9a0746968594a9fa2d247286bf1b7d5b237e61efb7b88535f76de: Status 404 returned error can't find the container with id 9e79fd6448d9a0746968594a9fa2d247286bf1b7d5b237e61efb7b88535f76de
Jul 30 20:57:41.549488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.549452    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:41.549574 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.549519    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:41.549574 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.549554    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:41.874127 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.874096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerStarted","Data":"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"}
Jul 30 20:57:41.874293 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.874148    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerStarted","Data":"9e79fd6448d9a0746968594a9fa2d247286bf1b7d5b237e61efb7b88535f76de"}
Jul 30 20:57:41.897436 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:41.897389    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podStartSLOduration=0.897374011 podStartE2EDuration="897.374011ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:41.895484105 +0000 UTC m=+1949.149824375" watchObservedRunningTime="2026-07-30 20:57:41.897374011 +0000 UTC m=+1949.151714343"
Jul 30 20:57:42.415633 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:42.415604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:42.420086 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:42.420064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:42.879041 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:42.879015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:42.880041 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:42.880024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:57.880391 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.880354    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:57:57.880774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.880409    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:57:57.950817 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.950765    2560 generic.go:356] "Generic (PLEG): container finished" podID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerID="0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b" exitCode=0
Jul 30 20:57:57.950947 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.950837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerDied","Data":"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"}
Jul 30 20:57:57.951237 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.951214    2560 scope.go:117] "RemoveContainer" containerID="0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"
Jul 30 20:57:57.952264 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.952236    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:57.952324 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.952305    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:57.952357 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:57.952341    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:57:58.959630 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:58.959599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerStarted","Data":"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"}
Jul 30 20:57:59.415587 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:59.415555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:57:59.415829 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:59.415807    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:57:59.415912 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:57:59.415892    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:58:00.415947 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:00.415908    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:58:00.416321 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:00.415966    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:58:01.415944 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:01.415911    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:58:01.416122 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:01.415967    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:58:02.415983 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:02.415944    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:58:02.416154 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:02.416003    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:58:03.415922 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:03.415885    2560 patch_prober.go:28] interesting pod/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 30 20:58:03.416082 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:03.415936    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 30 20:58:04.419404 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:04.419374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:58:04.419844 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:04.419697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:58:04.420410 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:04.420395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:58:25.245712 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:25.245611    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:58:25.246334 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:25.245888    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy" containerID="cri-o://f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370" gracePeriod=30
Jul 30 20:58:26.377567 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.377536    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:58:26.379750 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.379733    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.384023 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.383999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-24ee2314-gw-openshift-default-dockercfg-z8hwd\""
Jul 30 20:58:26.399510 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.399482    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:58:26.484336 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484509 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484509 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484509 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484615 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484615 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484615 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484615 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9rx7\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.484732 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.484618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585198 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585198 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585369 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585369 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9rx7\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585369 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585369 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585567 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585567 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585567 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585713 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585713 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.585853 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.586000 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.585955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.586353 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.586330    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.587667 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.587642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.587824 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.587804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.596309 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.596289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9rx7\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.596601 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.596584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token\") pod \"e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") " pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.689560 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.689502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:26.821056 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.821035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:58:26.822639 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:58:26.822610    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfab5e4d_7351_480b_9694_dccec498ea00.slice/crio-73c90810349dc0ffe67734d20fac12937107d0c4ce66bf3de296994f33619d89 WatchSource:0}: Error finding container 73c90810349dc0ffe67734d20fac12937107d0c4ce66bf3de296994f33619d89: Status 404 returned error can't find the container with id 73c90810349dc0ffe67734d20fac12937107d0c4ce66bf3de296994f33619d89
Jul 30 20:58:26.824681 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.824645    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:26.824761 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.824712    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:26.824761 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:26.824744    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:27.083344 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:27.083311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerStarted","Data":"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"}
Jul 30 20:58:27.083520 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:27.083359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerStarted","Data":"73c90810349dc0ffe67734d20fac12937107d0c4ce66bf3de296994f33619d89"}
Jul 30 20:58:27.105282 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:27.105237    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podStartSLOduration=1.105220991 podStartE2EDuration="1.105220991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:27.104383881 +0000 UTC m=+1994.358724183" watchObservedRunningTime="2026-07-30 20:58:27.105220991 +0000 UTC m=+1994.359561327"
Jul 30 20:58:27.690162 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:27.690126    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:27.695497 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:27.695472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:28.088372 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:28.088337    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:28.089107 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:28.089084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:30.488966 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.488942    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:58:30.626857 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.626829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.626987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.626870    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.626987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.626905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.626987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.626944    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.626987 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.626969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.627156 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.627156 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627037    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw546\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.627156 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.627156 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data\") pod \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\" (UID: \"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9\") "
Jul 30 20:58:30.627356 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627246    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:58:30.627444 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627423    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:58:30.627563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627253    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:58:30.627563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627441    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.627563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627460    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:58:30.627563 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.627502    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:58:30.629194 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.629168    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546" (OuterVolumeSpecName: "kube-api-access-xw546") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "kube-api-access-xw546". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:58:30.629279 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.629222    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:58:30.629279 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.629232    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:58:30.629368 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.629285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" (UID: "4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:58:30.728651 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728628    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728651 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728648    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728658    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728666    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728674    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728682    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw546\" (UniqueName: \"kubernetes.io/projected/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-kube-api-access-xw546\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728690    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:30.728862 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:30.728697    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:31.104490 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.104464    2560 generic.go:356] "Generic (PLEG): container finished" podID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerID="f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370" exitCode=0
Jul 30 20:58:31.104610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.104496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerDied","Data":"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"}
Jul 30 20:58:31.104610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.104516    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"
Jul 30 20:58:31.104610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.104533    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg" event={"ID":"4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9","Type":"ContainerDied","Data":"9e79fd6448d9a0746968594a9fa2d247286bf1b7d5b237e61efb7b88535f76de"}
Jul 30 20:58:31.104610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.104553    2560 scope.go:117] "RemoveContainer" containerID="f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"
Jul 30 20:58:31.113334 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.113317    2560 scope.go:117] "RemoveContainer" containerID="0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"
Jul 30 20:58:31.120586 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.120562    2560 scope.go:117] "RemoveContainer" containerID="f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"
Jul 30 20:58:31.120834 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:58:31.120817    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370\": container with ID starting with f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370 not found: ID does not exist" containerID="f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"
Jul 30 20:58:31.120906 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.120840    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370"} err="failed to get container status \"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370\": rpc error: code = NotFound desc = could not find container \"f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370\": container with ID starting with f5524d4d73d6ffc5e61a4fdfcd1c3c816fe4f34675a8fac026c10f7895c81370 not found: ID does not exist"
Jul 30 20:58:31.120906 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.120855    2560 scope.go:117] "RemoveContainer" containerID="0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"
Jul 30 20:58:31.121119 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:58:31.121081    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b\": container with ID starting with 0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b not found: ID does not exist" containerID="0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"
Jul 30 20:58:31.121119 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.121108    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b"} err="failed to get container status \"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b\": rpc error: code = NotFound desc = could not find container \"0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b\": container with ID starting with 0ab25fe3547091b5f243e95e190b468e1bbc655f54ec48bc281bae226c9c507b not found: ID does not exist"
Jul 30 20:58:31.157640 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.157615    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:58:31.163144 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.163121    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-83e97498-openshift-default-778457fdb-qhpmg"]
Jul 30 20:58:31.256298 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:31.256266    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" path="/var/lib/kubelet/pods/4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9/volumes"
Jul 30 20:58:42.155616 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.155584    2560 generic.go:356] "Generic (PLEG): container finished" podID="cfab5e4d-7351-480b-9694-dccec498ea00" containerID="79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf" exitCode=0
Jul 30 20:58:42.156016 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.155659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerDied","Data":"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"}
Jul 30 20:58:42.156016 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.156003    2560 scope.go:117] "RemoveContainer" containerID="79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"
Jul 30 20:58:42.156913 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.156886    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:42.156962 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.156952    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:42.157011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:42.156999    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:58:43.088591 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:43.088557    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:43.162301 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:43.162265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerStarted","Data":"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"}
Jul 30 20:58:43.701723 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:43.701693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:43.702069 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:43.702046    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 30 20:58:43.702245 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:43.702218    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 30 20:58:44.690219 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:44.690184    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 30 20:58:44.690792 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:44.690745    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 30 20:58:45.690801 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:45.690742    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 30 20:58:45.691391 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:45.691356    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 30 20:58:46.690167 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:46.690120    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 30 20:58:46.690373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:46.690187    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 30 20:58:47.689996 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:47.689950    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 30 20:58:47.690491 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:47.690023    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 30 20:58:48.694345 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:48.694315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:48.694742 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:48.694698    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:48.695365 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:48.695346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:58:53.624616 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624583    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"]
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624889    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624901    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624912    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624917    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624977    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.625011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.624983    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f8e8e80-d27b-4d6c-94ef-7c66d9ea4ff9" containerName="istio-proxy"
Jul 30 20:58:53.626657 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.626642    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:53.629599 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.629577    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:58:53.629702 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.629583    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 20:58:53.635645 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.635622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"]
Jul 30 20:58:53.723550 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.723524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs\" (UID: \"635f74c2-3c2d-43c6-860b-9ef06690d264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:53.824768 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.824742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs\" (UID: \"635f74c2-3c2d-43c6-860b-9ef06690d264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:53.825307 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.825286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs\" (UID: \"635f74c2-3c2d-43c6-860b-9ef06690d264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:53.937031 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:53.936974    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:54.086774 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:54.086692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"]
Jul 30 20:58:54.089338 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:58:54.089310    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635f74c2_3c2d_43c6_860b_9ef06690d264.slice/crio-d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62 WatchSource:0}: Error finding container d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62: Status 404 returned error can't find the container with id d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62
Jul 30 20:58:54.091616 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:54.091599    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:58:54.208203 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:54.208150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs" event={"ID":"635f74c2-3c2d-43c6-860b-9ef06690d264","Type":"ContainerStarted","Data":"d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62"}
Jul 30 20:58:57.225729 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:57.225657    2560 generic.go:356] "Generic (PLEG): container finished" podID="635f74c2-3c2d-43c6-860b-9ef06690d264" containerID="51fb4491ace45e813539cde2d96788d0d906084db5a6f83de5176c6ccb7e704c" exitCode=0
Jul 30 20:58:57.226071 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:57.225730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs" event={"ID":"635f74c2-3c2d-43c6-860b-9ef06690d264","Type":"ContainerDied","Data":"51fb4491ace45e813539cde2d96788d0d906084db5a6f83de5176c6ccb7e704c"}
Jul 30 20:58:58.355132 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:58.355111    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:58.364983 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:58.364966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca\") pod \"635f74c2-3c2d-43c6-860b-9ef06690d264\" (UID: \"635f74c2-3c2d-43c6-860b-9ef06690d264\") "
Jul 30 20:58:58.365280 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:58.365258    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "635f74c2-3c2d-43c6-860b-9ef06690d264" (UID: "635f74c2-3c2d-43c6-860b-9ef06690d264"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:58:58.466226 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:58.466197    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/635f74c2-3c2d-43c6-860b-9ef06690d264-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:58:59.236441 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:59.236414    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"
Jul 30 20:58:59.236596 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:59.236413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs" event={"ID":"635f74c2-3c2d-43c6-860b-9ef06690d264","Type":"ContainerDied","Data":"d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62"}
Jul 30 20:58:59.236596 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:58:59.236537    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d14c4fdbb3b3d78c7d9a2b8a62f9fb3a8171cddd3fd747c94c2de286185e62"
Jul 30 20:59:00.434443 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:00.434414    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"]
Jul 30 20:59:00.437283 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:00.437254    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-24ee2314-vkjcs"]
Jul 30 20:59:00.573453 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:00.573418    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:59:00.573719 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:00.573668    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" containerID="cri-o://9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712" gracePeriod=30
Jul 30 20:59:01.256172 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.256140    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="635f74c2-3c2d-43c6-860b-9ef06690d264" path="/var/lib/kubelet/pods/635f74c2-3c2d-43c6-860b-9ef06690d264/volumes"
Jul 30 20:59:01.380884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.380857    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:01.381304 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.381285    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="635f74c2-3c2d-43c6-860b-9ef06690d264" containerName="revoke-keys"
Jul 30 20:59:01.381304 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.381304    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="635f74c2-3c2d-43c6-860b-9ef06690d264" containerName="revoke-keys"
Jul 30 20:59:01.381489 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.381395    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="635f74c2-3c2d-43c6-860b-9ef06690d264" containerName="revoke-keys"
Jul 30 20:59:01.384450 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.384432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.387022 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.387002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-be8f5bad-openshift-default-dockercfg-wvt7t\""
Jul 30 20:59:01.397267 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.397234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:01.493182 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493182 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.493699 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.493486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzkp9\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.594616 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzkp9\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.594847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.594847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.594847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.594847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595084 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.594988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595275 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.595104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595347 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.595327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595386 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.595341    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595386 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.595369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.595495 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.595478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.597119 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.597093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.597222 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.597210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.603208 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.603191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzkp9\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.603302 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.603282    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token\") pod \"e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") " pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.696420 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.696392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:01.837342 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.837316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:01.840076 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:59:01.840047    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2154434_31df_4d11_b257_2f6641b56eaf.slice/crio-8418e12f9952886d023018d338b824dd0377c9e81d5532bc35e0ad31f027c1e9 WatchSource:0}: Error finding container 8418e12f9952886d023018d338b824dd0377c9e81d5532bc35e0ad31f027c1e9: Status 404 returned error can't find the container with id 8418e12f9952886d023018d338b824dd0377c9e81d5532bc35e0ad31f027c1e9
Jul 30 20:59:01.842210 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.842170    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:01.842299 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.842247    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:01.842299 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:01.842276    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:02.252029 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:02.251944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerStarted","Data":"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"}
Jul 30 20:59:02.252029 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:02.252003    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerStarted","Data":"8418e12f9952886d023018d338b824dd0377c9e81d5532bc35e0ad31f027c1e9"}
Jul 30 20:59:02.273385 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:02.273338    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podStartSLOduration=1.273321221 podStartE2EDuration="1.273321221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:59:02.27225985 +0000 UTC m=+2029.526600128" watchObservedRunningTime="2026-07-30 20:59:02.273321221 +0000 UTC m=+2029.527661491"
Jul 30 20:59:02.697256 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:02.697219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:02.701999 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:02.701977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:03.256537 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:03.256499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:03.257263 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:03.257244    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:03.697306 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:03.697271    2560 patch_prober.go:28] interesting pod/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:59:03.697665 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:03.697322    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:59:05.816450 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.816422    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:59:05.928455 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928383    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928455 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928455 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928454    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928481    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928509    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928563    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928691 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928908 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.928908 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928809    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:05.928908 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:59:05.928908 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.928827    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9rx7\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7\") pod \"cfab5e4d-7351-480b-9694-dccec498ea00\" (UID: \"cfab5e4d-7351-480b-9694-dccec498ea00\") "
Jul 30 20:59:05.929150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929000    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:05.929150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:05.929150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929129    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:05.929892 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929857    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfab5e4d-7351-480b-9694-dccec498ea00-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:05.929892 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929884    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:05.930145 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929899    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:05.930145 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929920    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:05.930145 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.929932    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:05.931266 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.931021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:05.935432 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.931620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:59:05.935432 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.932107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7" (OuterVolumeSpecName: "kube-api-access-s9rx7") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "kube-api-access-s9rx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:59:05.936551 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:05.936513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfab5e4d-7351-480b-9694-dccec498ea00" (UID: "cfab5e4d-7351-480b-9694-dccec498ea00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:59:06.031026 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.031001    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:06.031026 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.031024    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfab5e4d-7351-480b-9694-dccec498ea00-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:06.031150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.031034    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9rx7\" (UniqueName: \"kubernetes.io/projected/cfab5e4d-7351-480b-9694-dccec498ea00-kube-api-access-s9rx7\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:06.031150 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.031043    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfab5e4d-7351-480b-9694-dccec498ea00-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:06.270534 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.270451    2560 generic.go:356] "Generic (PLEG): container finished" podID="cfab5e4d-7351-480b-9694-dccec498ea00" containerID="9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712" exitCode=0
Jul 30 20:59:06.270534 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.270514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerDied","Data":"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"}
Jul 30 20:59:06.270534 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.270521    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"
Jul 30 20:59:06.270713 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.270564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh" event={"ID":"cfab5e4d-7351-480b-9694-dccec498ea00","Type":"ContainerDied","Data":"73c90810349dc0ffe67734d20fac12937107d0c4ce66bf3de296994f33619d89"}
Jul 30 20:59:06.270713 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.270597    2560 scope.go:117] "RemoveContainer" containerID="9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"
Jul 30 20:59:06.279392 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.279373    2560 scope.go:117] "RemoveContainer" containerID="79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"
Jul 30 20:59:06.286969 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.286952    2560 scope.go:117] "RemoveContainer" containerID="9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"
Jul 30 20:59:06.287189 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:59:06.287166    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712\": container with ID starting with 9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712 not found: ID does not exist" containerID="9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"
Jul 30 20:59:06.287238 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.287196    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712"} err="failed to get container status \"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712\": rpc error: code = NotFound desc = could not find container \"9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712\": container with ID starting with 9e6195eb19c2b95a680b32ab4b15b534d54f761c9b1cb4428303f92a8aa5d712 not found: ID does not exist"
Jul 30 20:59:06.287238 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.287212    2560 scope.go:117] "RemoveContainer" containerID="79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"
Jul 30 20:59:06.287440 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:59:06.287420    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf\": container with ID starting with 79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf not found: ID does not exist" containerID="79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"
Jul 30 20:59:06.287498 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.287450    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf"} err="failed to get container status \"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf\": rpc error: code = NotFound desc = could not find container \"79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf\": container with ID starting with 79865198450c747a10b5dfcabe33cab4316bdaeb152fc33a8273eee3922fd6bf not found: ID does not exist"
Jul 30 20:59:06.320049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.320030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:59:06.335225 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:06.335195    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-24ee2314-gw-openshift-default-786cc8b9b4-pqkkh"]
Jul 30 20:59:07.256664 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:07.256631    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" path="/var/lib/kubelet/pods/cfab5e4d-7351-480b-9694-dccec498ea00/volumes"
Jul 30 20:59:18.402929 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:18.402096    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:58394->10.133.0.31:15021: read: connection reset by peer" start-of-body=
Jul 30 20:59:18.402929 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:18.402162    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:58394->10.133.0.31:15021: read: connection reset by peer"
Jul 30 20:59:19.340428 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.340390    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2154434-31df-4d11-b257-2f6641b56eaf" containerID="8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3" exitCode=0
Jul 30 20:59:19.340590 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.340464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerDied","Data":"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"}
Jul 30 20:59:19.340863 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.340850    2560 scope.go:117] "RemoveContainer" containerID="8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"
Jul 30 20:59:19.341859 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.341830    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:19.341941 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.341900    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:19.341941 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:19.341935    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:20.346869 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:20.346833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerStarted","Data":"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"}
Jul 30 20:59:20.696884 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:20.696768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:20.697269 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:20.697237    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 30 20:59:20.697357 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:20.697322    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 30 20:59:21.697929 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:21.697447    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 30 20:59:21.697929 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:21.697517    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 30 20:59:22.697290 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:22.697254    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 30 20:59:22.697610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:22.697579    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 30 20:59:23.700138 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:23.700101    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 30 20:59:23.700605 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:23.700179    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 30 20:59:24.698083 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:24.697648    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 30 20:59:24.698083 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:24.697707    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 30 20:59:25.700218 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:25.700191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:25.700606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:25.700449    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:25.701171 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:25.701152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:29.523027 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.522994    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"]
Jul 30 20:59:29.523391 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.523294    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:29.523391 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.523305    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:29.523391 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.523364    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:29.529871 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.529850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:29.532499 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.532476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:59:29.532612 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.532539    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 20:59:29.536748 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.536432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"]
Jul 30 20:59:29.625792 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.625751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm\" (UID: \"a4ea78aa-b14d-4428-93e7-7cd92597488d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:29.726606 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.726584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm\" (UID: \"a4ea78aa-b14d-4428-93e7-7cd92597488d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:29.727133 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.727116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm\" (UID: \"a4ea78aa-b14d-4428-93e7-7cd92597488d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:29.840851 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.840829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:29.965009 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:29.964977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"]
Jul 30 20:59:29.968554 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:59:29.968526    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ea78aa_b14d_4428_93e7_7cd92597488d.slice/crio-03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005 WatchSource:0}: Error finding container 03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005: Status 404 returned error can't find the container with id 03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005
Jul 30 20:59:30.393131 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:30.393106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm" event={"ID":"a4ea78aa-b14d-4428-93e7-7cd92597488d","Type":"ContainerStarted","Data":"6e56c49090ce93f182135a215d6c5c54d6e459c7fa68bc1c6443f5660379fccf"}
Jul 30 20:59:30.393218 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:30.393155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm" event={"ID":"a4ea78aa-b14d-4428-93e7-7cd92597488d","Type":"ContainerStarted","Data":"03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005"}
Jul 30 20:59:30.408713 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:30.408668    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm" podStartSLOduration=1.408655091 podStartE2EDuration="1.408655091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:59:30.407843191 +0000 UTC m=+2057.662183481" watchObservedRunningTime="2026-07-30 20:59:30.408655091 +0000 UTC m=+2057.662995360"
Jul 30 20:59:31.398297 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:31.398258    2560 generic.go:356] "Generic (PLEG): container finished" podID="a4ea78aa-b14d-4428-93e7-7cd92597488d" containerID="6e56c49090ce93f182135a215d6c5c54d6e459c7fa68bc1c6443f5660379fccf" exitCode=0
Jul 30 20:59:31.398687 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:31.398336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm" event={"ID":"a4ea78aa-b14d-4428-93e7-7cd92597488d","Type":"ContainerDied","Data":"6e56c49090ce93f182135a215d6c5c54d6e459c7fa68bc1c6443f5660379fccf"}
Jul 30 20:59:32.534455 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:32.534430    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:32.652011 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:32.651983    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca\") pod \"a4ea78aa-b14d-4428-93e7-7cd92597488d\" (UID: \"a4ea78aa-b14d-4428-93e7-7cd92597488d\") "
Jul 30 20:59:32.652309 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:32.652286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4ea78aa-b14d-4428-93e7-7cd92597488d" (UID: "a4ea78aa-b14d-4428-93e7-7cd92597488d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:59:32.753209 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:32.753150    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ea78aa-b14d-4428-93e7-7cd92597488d-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:33.408481 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:33.408459    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"
Jul 30 20:59:33.408610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:33.408459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm" event={"ID":"a4ea78aa-b14d-4428-93e7-7cd92597488d","Type":"ContainerDied","Data":"03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005"}
Jul 30 20:59:33.408610 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:33.408580    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03a99ebd7290ce8f6a143cd28cdcb84ad425ca5b99da56e9cda41f3ec49af005"
Jul 30 20:59:35.643491 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:35.643415    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"]
Jul 30 20:59:35.646602 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:35.646577    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-be8f5bad-kj2jm"]
Jul 30 20:59:36.818392 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:36.818362    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:36.818851 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:36.818640    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" containerID="cri-o://cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c" gracePeriod=30
Jul 30 20:59:37.256723 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.256646    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ea78aa-b14d-4428-93e7-7cd92597488d" path="/var/lib/kubelet/pods/a4ea78aa-b14d-4428-93e7-7cd92597488d/volumes"
Jul 30 20:59:37.638894 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.638861    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 20:59:37.639259 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:37.639322 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639261    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:37.639322 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639273    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ea78aa-b14d-4428-93e7-7cd92597488d" containerName="revoke-keys"
Jul 30 20:59:37.639322 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639279    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ea78aa-b14d-4428-93e7-7cd92597488d" containerName="revoke-keys"
Jul 30 20:59:37.639464 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639325    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfab5e4d-7351-480b-9694-dccec498ea00" containerName="istio-proxy"
Jul 30 20:59:37.639464 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.639336    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ea78aa-b14d-4428-93e7-7cd92597488d" containerName="revoke-keys"
Jul 30 20:59:37.642370 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.642355    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.645346 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.645322    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-052492e6-openshift-default-dockercfg-zqmsq\""
Jul 30 20:59:37.655445 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.655425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 20:59:37.793486 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793486 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793599    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.793738 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpjj\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.794049 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.793772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.894962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.894996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895033 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpjj\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.895548 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.896039 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.895686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.896097 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.896077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.897222 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.897199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.897488 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.897470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.903002 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.902977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.903898 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.903876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpjj\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj\") pod \"e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") " pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:37.951521 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:37.951493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:38.089775 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.089752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 20:59:38.092991 ip-10-0-139-183 kubenswrapper[2560]: W0730 20:59:38.092961    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21584f57_7169_4f20_9cf9_3495a9ccf6f7.slice/crio-399c6f3c1c926f5dabd52243219305b05e728df9a19f759b7b00b30c4ea54d53 WatchSource:0}: Error finding container 399c6f3c1c926f5dabd52243219305b05e728df9a19f759b7b00b30c4ea54d53: Status 404 returned error can't find the container with id 399c6f3c1c926f5dabd52243219305b05e728df9a19f759b7b00b30c4ea54d53
Jul 30 20:59:38.095652 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.095614    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:38.095730 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.095694    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:38.095766 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.095735    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:38.432719 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.432631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerStarted","Data":"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"}
Jul 30 20:59:38.432719 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.432689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerStarted","Data":"399c6f3c1c926f5dabd52243219305b05e728df9a19f759b7b00b30c4ea54d53"}
Jul 30 20:59:38.455740 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.455698    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podStartSLOduration=1.455684205 podStartE2EDuration="1.455684205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:59:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:59:38.45382304 +0000 UTC m=+2065.708163311" watchObservedRunningTime="2026-07-30 20:59:38.455684205 +0000 UTC m=+2065.710024473"
Jul 30 20:59:38.951923 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:38.951896    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:39.957048 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:39.957016    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:40.441596 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:40.441571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:40.442537 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:40.442515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:40.703373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:40.703295    2560 patch_prober.go:28] interesting pod/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:59:40.703373 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:40.703355    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:59:42.067387 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.067364    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:42.237735 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237664    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.237735 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.237735 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzkp9\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238040 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238040 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237878    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238040 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237923    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238040 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.237956    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238040 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238016    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238318 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238054    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket\") pod \"c2154434-31df-4d11-b257-2f6641b56eaf\" (UID: \"c2154434-31df-4d11-b257-2f6641b56eaf\") "
Jul 30 20:59:42.238318 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:42.238318 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238213    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:42.238477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238380    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:42.238477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238417    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:42.238477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238441    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.238477 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238463    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.238676 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.238616    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:59:42.239900 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.239872    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:59:42.240014 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.239977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:59:42.240014 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.239988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:59:42.240014 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.239978    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9" (OuterVolumeSpecName: "kube-api-access-jzkp9") pod "c2154434-31df-4d11-b257-2f6641b56eaf" (UID: "c2154434-31df-4d11-b257-2f6641b56eaf"). InnerVolumeSpecName "kube-api-access-jzkp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:59:42.339874 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339846    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.339874 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339869    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2154434-31df-4d11-b257-2f6641b56eaf-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.339874 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339878    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.340058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339886    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2154434-31df-4d11-b257-2f6641b56eaf-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.340058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339894    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2154434-31df-4d11-b257-2f6641b56eaf-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.340058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339904    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzkp9\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-kube-api-access-jzkp9\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.340058 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.339912    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2154434-31df-4d11-b257-2f6641b56eaf-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 20:59:42.453967 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.453935    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2154434-31df-4d11-b257-2f6641b56eaf" containerID="cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c" exitCode=0
Jul 30 20:59:42.454101 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.453986    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"
Jul 30 20:59:42.454101 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.454020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerDied","Data":"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"}
Jul 30 20:59:42.454101 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.454074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs" event={"ID":"c2154434-31df-4d11-b257-2f6641b56eaf","Type":"ContainerDied","Data":"8418e12f9952886d023018d338b824dd0377c9e81d5532bc35e0ad31f027c1e9"}
Jul 30 20:59:42.454200 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.454103    2560 scope.go:117] "RemoveContainer" containerID="cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"
Jul 30 20:59:42.463161 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.463143    2560 scope.go:117] "RemoveContainer" containerID="8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"
Jul 30 20:59:42.472266 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.472240    2560 scope.go:117] "RemoveContainer" containerID="cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"
Jul 30 20:59:42.472767 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:59:42.472746    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c\": container with ID starting with cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c not found: ID does not exist" containerID="cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"
Jul 30 20:59:42.472847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.472799    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c"} err="failed to get container status \"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c\": rpc error: code = NotFound desc = could not find container \"cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c\": container with ID starting with cde13176564c127c297c8d621e0d43f1e62578b987777969bbd7d01a9168f07c not found: ID does not exist"
Jul 30 20:59:42.472847 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.472823    2560 scope.go:117] "RemoveContainer" containerID="8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"
Jul 30 20:59:42.473118 ip-10-0-139-183 kubenswrapper[2560]: E0730 20:59:42.473095    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3\": container with ID starting with 8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3 not found: ID does not exist" containerID="8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"
Jul 30 20:59:42.473162 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.473127    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3"} err="failed to get container status \"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3\": rpc error: code = NotFound desc = could not find container \"8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3\": container with ID starting with 8de5df881af9cf927c3282efe286dd5aa523f43beeb7db86fb3405a5413413c3 not found: ID does not exist"
Jul 30 20:59:42.477292 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.477272    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:42.482273 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:42.482252    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-be8f5bad-openshift-default-86947cd46b-d9fqs"]
Jul 30 20:59:43.256379 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:43.256343    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" path="/var/lib/kubelet/pods/c2154434-31df-4d11-b257-2f6641b56eaf/volumes"
Jul 30 20:59:54.510629 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.510592    2560 generic.go:356] "Generic (PLEG): container finished" podID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerID="ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1" exitCode=0
Jul 30 20:59:54.511094 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.510664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerDied","Data":"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"}
Jul 30 20:59:54.511094 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.511058    2560 scope.go:117] "RemoveContainer" containerID="ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"
Jul 30 20:59:54.512017 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.511990    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:54.512070 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.512059    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:54.512113 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:54.512101    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 20:59:55.442345 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:55.442310    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:55.516863 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:55.516826    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerStarted","Data":"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"}
Jul 30 20:59:55.951821 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:55.951771    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 20:59:55.952643 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:55.952619    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 30 20:59:55.952731 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:55.952669    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 30 20:59:56.952846 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:56.952813    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 30 20:59:56.953233 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:56.952867    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 30 20:59:57.952984 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:57.952945    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 30 20:59:57.953379 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:57.953007    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 30 20:59:58.952251 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:58.952213    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 30 20:59:58.952431 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:58.952271    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 30 20:59:59.952094 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:59.952056    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 30 20:59:59.952568 ip-10-0-139-183 kubenswrapper[2560]: I0730 20:59:59.952115    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 30 21:00:00.133333 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.133284    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"]
Jul 30 21:00:00.133707 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.133688    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.133819 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.133710    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.133881 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.133839    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.135824 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.135803    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"]
Jul 30 21:00:00.135933 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.135897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"
Jul 30 21:00:00.136196 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.136175    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.136258 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.136198    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.136296 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.136259    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2154434-31df-4d11-b257-2f6641b56eaf" containerName="istio-proxy"
Jul 30 21:00:00.137924 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.137908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"
Jul 30 21:00:00.138474 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.138458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:00:00.144407 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.144386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"]
Jul 30 21:00:00.146305 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.146284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"]
Jul 30 21:00:00.146988 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.146970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"
Jul 30 21:00:00.155472 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.155452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"
Jul 30 21:00:00.303280 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.301831    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"]
Jul 30 21:00:00.338559 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.338530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"]
Jul 30 21:00:00.347810 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:00:00.347758    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cb731e_2dc3_4b02_8e5d_b97d99ebff4d.slice/crio-1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7 WatchSource:0}: Error finding container 1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7: Status 404 returned error can't find the container with id 1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7
Jul 30 21:00:00.539391 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.539358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht" event={"ID":"c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d","Type":"ContainerStarted","Data":"1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7"}
Jul 30 21:00:00.540432 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.540403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c" event={"ID":"8f62aa65-9f7e-4117-9f16-cb6890acc480","Type":"ContainerStarted","Data":"b78907209da479a3d417834411efdebd7021e895bf7110434cf97b52654a7ae8"}
Jul 30 21:00:00.955941 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.955910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 21:00:00.956373 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.956194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 21:00:00.956990 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:00.956973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 21:00:01.546310 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:01.546220    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d" containerID="885139de2d16afb9582fc8fa441ba2b90d83c12ca913bef761ed518e2963b184" exitCode=0
Jul 30 21:00:01.546453 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:01.546310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht" event={"ID":"c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d","Type":"ContainerDied","Data":"885139de2d16afb9582fc8fa441ba2b90d83c12ca913bef761ed518e2963b184"}
Jul 30 21:00:01.547727 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:01.547702    2560 generic.go:356] "Generic (PLEG): container finished" podID="8f62aa65-9f7e-4117-9f16-cb6890acc480" containerID="1b6256211267b0526b919ca123d2ffc55fc144657bbf25d294b167ad16476848" exitCode=0
Jul 30 21:00:01.547860 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:01.547803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c" event={"ID":"8f62aa65-9f7e-4117-9f16-cb6890acc480","Type":"ContainerDied","Data":"1b6256211267b0526b919ca123d2ffc55fc144657bbf25d294b167ad16476848"}
Jul 30 21:00:02.677821 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:02.677799    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"
Jul 30 21:00:02.701508 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:02.701481    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"
Jul 30 21:00:03.557749 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.557670    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht"
Jul 30 21:00:03.557749 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.557681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757420-f68ht" event={"ID":"c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d","Type":"ContainerDied","Data":"1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7"}
Jul 30 21:00:03.557749 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.557730    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cf597e7d634b065787a656dd8e9a5f10a41b0e2bd4dfa629dd5210ea43f99e7"
Jul 30 21:00:03.559031 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.559009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c" event={"ID":"8f62aa65-9f7e-4117-9f16-cb6890acc480","Type":"ContainerDied","Data":"b78907209da479a3d417834411efdebd7021e895bf7110434cf97b52654a7ae8"}
Jul 30 21:00:03.559031 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.559022    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"
Jul 30 21:00:03.559159 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:03.559045    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b78907209da479a3d417834411efdebd7021e895bf7110434cf97b52654a7ae8"
Jul 30 21:00:04.725849 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.725819    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"]
Jul 30 21:00:04.726197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726128    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f62aa65-9f7e-4117-9f16-cb6890acc480" containerName="cleanup"
Jul 30 21:00:04.726197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726139    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f62aa65-9f7e-4117-9f16-cb6890acc480" containerName="cleanup"
Jul 30 21:00:04.726197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726155    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d" containerName="cleanup"
Jul 30 21:00:04.726197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726160    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d" containerName="cleanup"
Jul 30 21:00:04.726332 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726208    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d" containerName="cleanup"
Jul 30 21:00:04.726332 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.726218    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f62aa65-9f7e-4117-9f16-cb6890acc480" containerName="cleanup"
Jul 30 21:00:04.727962 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.727944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:04.730500 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.730476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:00:04.730500 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.730491    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:00:04.739069 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.739034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"]
Jul 30 21:00:04.839937 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.839907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-052492e6-srzwv\" (UID: \"5baeb7e3-128b-4044-8431-392852e2ccc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:04.940619 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.940588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-052492e6-srzwv\" (UID: \"5baeb7e3-128b-4044-8431-392852e2ccc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:04.941171 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:04.941153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-052492e6-srzwv\" (UID: \"5baeb7e3-128b-4044-8431-392852e2ccc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:05.040996 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:05.040934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:05.164602 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:05.164569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"]
Jul 30 21:00:05.167506 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:00:05.167479    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5baeb7e3_128b_4044_8431_392852e2ccc8.slice/crio-36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da WatchSource:0}: Error finding container 36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da: Status 404 returned error can't find the container with id 36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da
Jul 30 21:00:05.570502 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:05.570466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv" event={"ID":"5baeb7e3-128b-4044-8431-392852e2ccc8","Type":"ContainerStarted","Data":"1b2065033ff67440d6d3b379f98d58927a0c7ebe9d40c9faa7ea000189cb8bbe"}
Jul 30 21:00:05.570629 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:05.570528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv" event={"ID":"5baeb7e3-128b-4044-8431-392852e2ccc8","Type":"ContainerStarted","Data":"36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da"}
Jul 30 21:00:05.587177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:05.587133    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv" podStartSLOduration=1.587116374 podStartE2EDuration="1.587116374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:00:05.585352845 +0000 UTC m=+2092.839693115" watchObservedRunningTime="2026-07-30 21:00:05.587116374 +0000 UTC m=+2092.841456644"
Jul 30 21:00:06.575898 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:06.575865    2560 generic.go:356] "Generic (PLEG): container finished" podID="5baeb7e3-128b-4044-8431-392852e2ccc8" containerID="1b2065033ff67440d6d3b379f98d58927a0c7ebe9d40c9faa7ea000189cb8bbe" exitCode=0
Jul 30 21:00:06.576516 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:06.575958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv" event={"ID":"5baeb7e3-128b-4044-8431-392852e2ccc8","Type":"ContainerDied","Data":"1b2065033ff67440d6d3b379f98d58927a0c7ebe9d40c9faa7ea000189cb8bbe"}
Jul 30 21:00:07.703756 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:07.703735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:07.764822 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:07.764773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca\") pod \"5baeb7e3-128b-4044-8431-392852e2ccc8\" (UID: \"5baeb7e3-128b-4044-8431-392852e2ccc8\") "
Jul 30 21:00:07.765085 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:07.765064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5baeb7e3-128b-4044-8431-392852e2ccc8" (UID: "5baeb7e3-128b-4044-8431-392852e2ccc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:00:07.865725 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:07.865664    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5baeb7e3-128b-4044-8431-392852e2ccc8-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:08.585298 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:08.585273    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"
Jul 30 21:00:08.585298 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:08.585287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv" event={"ID":"5baeb7e3-128b-4044-8431-392852e2ccc8","Type":"ContainerDied","Data":"36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da"}
Jul 30 21:00:08.585510 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:08.585336    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36e190869bcdb03ad19c7d417c883129e4b4f77fb2ba7f5ee16e77957647e9da"
Jul 30 21:00:11.519493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.519457    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"]
Jul 30 21:00:11.525993 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.525965    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-052492e6-29757420-8mn2c"]
Jul 30 21:00:11.797766 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.797685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"]
Jul 30 21:00:11.800374 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.800350    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-052492e6-srzwv"]
Jul 30 21:00:11.944382 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.944344    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 21:00:11.944647 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:11.944613    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" containerID="cri-o://d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111" gracePeriod=30
Jul 30 21:00:13.257891 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:13.257857    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5baeb7e3-128b-4044-8431-392852e2ccc8" path="/var/lib/kubelet/pods/5baeb7e3-128b-4044-8431-392852e2ccc8/volumes"
Jul 30 21:00:13.258367 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:13.258260    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f62aa65-9f7e-4117-9f16-cb6890acc480" path="/var/lib/kubelet/pods/8f62aa65-9f7e-4117-9f16-cb6890acc480/volumes"
Jul 30 21:00:15.958834 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:15.958769    2560 patch_prober.go:28] interesting pod/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:00:15.959331 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:15.958890    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:00:17.194876 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.194849    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 21:00:17.341879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.341850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.341879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.341881    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.341908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.341923    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.341951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qpjj\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342017    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342093    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342420 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket\") pod \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\" (UID: \"21584f57-7169-4f20-9cf9-3495a9ccf6f7\") "
Jul 30 21:00:17.342420 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342141    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:17.342420 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342157    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:17.342420 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342337    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.342420 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342355    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.342636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:17.342636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342364    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:00:17.342636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.342523    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:17.344112 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.344084    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:00:17.344245 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.344166    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:00:17.344493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.344462    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:17.344493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.344477    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj" (OuterVolumeSpecName: "kube-api-access-5qpjj") pod "21584f57-7169-4f20-9cf9-3495a9ccf6f7" (UID: "21584f57-7169-4f20-9cf9-3495a9ccf6f7"). InnerVolumeSpecName "kube-api-access-5qpjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:00:17.443213 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443180    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443213 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443207    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443219    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qpjj\" (UniqueName: \"kubernetes.io/projected/21584f57-7169-4f20-9cf9-3495a9ccf6f7-kube-api-access-5qpjj\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443233    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443245    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443255    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21584f57-7169-4f20-9cf9-3495a9ccf6f7-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.443400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.443265    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21584f57-7169-4f20-9cf9-3495a9ccf6f7-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:00:17.629746 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.629656    2560 generic.go:356] "Generic (PLEG): container finished" podID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerID="d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111" exitCode=0
Jul 30 21:00:17.629746 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.629708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"
Jul 30 21:00:17.630002 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.629742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerDied","Data":"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"}
Jul 30 21:00:17.630002 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.629821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx" event={"ID":"21584f57-7169-4f20-9cf9-3495a9ccf6f7","Type":"ContainerDied","Data":"399c6f3c1c926f5dabd52243219305b05e728df9a19f759b7b00b30c4ea54d53"}
Jul 30 21:00:17.630002 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.629851    2560 scope.go:117] "RemoveContainer" containerID="d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"
Jul 30 21:00:17.640968 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.640944    2560 scope.go:117] "RemoveContainer" containerID="ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"
Jul 30 21:00:17.648871 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.648852    2560 scope.go:117] "RemoveContainer" containerID="d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"
Jul 30 21:00:17.649126 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:00:17.649105    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111\": container with ID starting with d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111 not found: ID does not exist" containerID="d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"
Jul 30 21:00:17.649174 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.649135    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111"} err="failed to get container status \"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111\": rpc error: code = NotFound desc = could not find container \"d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111\": container with ID starting with d5260fdcd39bdd13b8d974767e7ad72cf7640eeec28a2640a11d3912439e7111 not found: ID does not exist"
Jul 30 21:00:17.649174 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.649153    2560 scope.go:117] "RemoveContainer" containerID="ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"
Jul 30 21:00:17.649397 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:00:17.649379    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1\": container with ID starting with ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1 not found: ID does not exist" containerID="ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"
Jul 30 21:00:17.649443 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.649403    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1"} err="failed to get container status \"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1\": rpc error: code = NotFound desc = could not find container \"ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1\": container with ID starting with ab2fe417afe10cf5903e35c08095ac50896e0d285bc544b7cadd6d83a73224e1 not found: ID does not exist"
Jul 30 21:00:17.653681 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.653659    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 21:00:17.657766 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:17.657746    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-052492e6-openshift-default-5f786ccf96-pb5wx"]
Jul 30 21:00:19.256016 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:00:19.255980    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" path="/var/lib/kubelet/pods/21584f57-7169-4f20-9cf9-3495a9ccf6f7/volumes"
Jul 30 21:02:10.877468 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877426    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877754    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5baeb7e3-128b-4044-8431-392852e2ccc8" containerName="revoke-keys"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877766    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5baeb7e3-128b-4044-8431-392852e2ccc8" containerName="revoke-keys"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877775    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877796    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877857    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5baeb7e3-128b-4044-8431-392852e2ccc8" containerName="revoke-keys"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877864    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:10.878004 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.877870    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:10.880947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.880932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.883566 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.883544    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-577a5369-openshift-default-dockercfg-kgstk\""
Jul 30 21:02:10.901792 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.901760    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:02:10.967960 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.967925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.967967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84st\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.967993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968170 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968483 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:10.968483 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:10.968296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069075 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069075 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84st\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069706 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069764 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069892 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.069892 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.069865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.070499 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.070478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.071515 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.071487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.071636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.071617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.098251 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.098214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.098521 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.098492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84st\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st\") pod \"e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") " pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.192006 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.191916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:11.349441 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.349350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:02:11.351522 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:02:11.351494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44737ba_bf42_4d11_9896_2386aa2fe28b.slice/crio-fe39e694a41e43314012740ba5c99b65676b89850cfba27d6006dca1db7450fb WatchSource:0}: Error finding container fe39e694a41e43314012740ba5c99b65676b89850cfba27d6006dca1db7450fb: Status 404 returned error can't find the container with id fe39e694a41e43314012740ba5c99b65676b89850cfba27d6006dca1db7450fb
Jul 30 21:02:11.353482 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.353448    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:11.353587 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.353526    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:11.353587 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:11.353578    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:12.141964 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:12.141935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerStarted","Data":"c4b19a2b6fbceb4dd65a4a217745ac4439ca5cd2708ef7e44505997a202aa512"}
Jul 30 21:02:12.142332 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:12.141987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerStarted","Data":"fe39e694a41e43314012740ba5c99b65676b89850cfba27d6006dca1db7450fb"}
Jul 30 21:02:12.164281 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:12.164226    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podStartSLOduration=2.164207166 podStartE2EDuration="2.164207166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:12.162913142 +0000 UTC m=+2219.417253435" watchObservedRunningTime="2026-07-30 21:02:12.164207166 +0000 UTC m=+2219.418547436"
Jul 30 21:02:12.192249 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:12.192224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:12.197344 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:12.197322    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:13.146683 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:13.146646    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:13.147642 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:13.147626    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:28.147934 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.147902    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 30 21:02:28.148326 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.147954    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 30 21:02:28.223741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.223711    2560 generic.go:356] "Generic (PLEG): container finished" podID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerID="c4b19a2b6fbceb4dd65a4a217745ac4439ca5cd2708ef7e44505997a202aa512" exitCode=0
Jul 30 21:02:28.223890 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.223806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerDied","Data":"c4b19a2b6fbceb4dd65a4a217745ac4439ca5cd2708ef7e44505997a202aa512"}
Jul 30 21:02:28.224173 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.224158    2560 scope.go:117] "RemoveContainer" containerID="c4b19a2b6fbceb4dd65a4a217745ac4439ca5cd2708ef7e44505997a202aa512"
Jul 30 21:02:28.225194 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.225162    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:28.225284 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.225267    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:28.225320 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:28.225309    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:02:29.230758 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:29.230721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerStarted","Data":"233ef1906e5e70eea6a85d73e1321fbc6bdcc9c3c3270be0b20b5230d65a8064"}
Jul 30 21:02:30.192660 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:30.192627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:30.193043 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:30.192961    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 30 21:02:30.193215 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:30.193190    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 30 21:02:31.193359 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:31.193322    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 30 21:02:31.193985 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:31.193950    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 30 21:02:32.192959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:32.192927    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 30 21:02:32.193275 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:32.193233    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 30 21:02:33.193384 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:33.193336    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 30 21:02:33.193937 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:33.193408    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 30 21:02:34.196470 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:34.196440    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:34.196853 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:34.196804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:34.197518 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:34.197496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:02:46.136472 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.136384    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"]
Jul 30 21:02:46.137073 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.136887    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:46.137073 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.136906    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21584f57-7169-4f20-9cf9-3495a9ccf6f7" containerName="istio-proxy"
Jul 30 21:02:46.139071 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.139049    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:46.141617 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.141596    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:02:46.141721 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.141665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:02:46.148115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.148093    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"]
Jul 30 21:02:46.180442 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.180412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-577a5369-qg622\" (UID: \"3cfc8564-7e28-40b7-bb50-20d45cb6ab44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:46.281520 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.281482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-577a5369-qg622\" (UID: \"3cfc8564-7e28-40b7-bb50-20d45cb6ab44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:46.282084 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.282060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-577a5369-qg622\" (UID: \"3cfc8564-7e28-40b7-bb50-20d45cb6ab44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:46.450059 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.449973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:46.576081 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:46.576057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"]
Jul 30 21:02:46.578533 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:02:46.578506    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfc8564_7e28_40b7_bb50_20d45cb6ab44.slice/crio-fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b WatchSource:0}: Error finding container fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b: Status 404 returned error can't find the container with id fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b
Jul 30 21:02:47.307842 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:47.307807    2560 generic.go:356] "Generic (PLEG): container finished" podID="3cfc8564-7e28-40b7-bb50-20d45cb6ab44" containerID="f037db28fd49b05b9cacdcaf3755cd1790ab8ace8fcc22a4d5cd88b3294d19b8" exitCode=0
Jul 30 21:02:47.308172 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:47.307881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622" event={"ID":"3cfc8564-7e28-40b7-bb50-20d45cb6ab44","Type":"ContainerDied","Data":"f037db28fd49b05b9cacdcaf3755cd1790ab8ace8fcc22a4d5cd88b3294d19b8"}
Jul 30 21:02:47.308172 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:47.307926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622" event={"ID":"3cfc8564-7e28-40b7-bb50-20d45cb6ab44","Type":"ContainerStarted","Data":"fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b"}
Jul 30 21:02:48.435463 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:48.435441    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:48.502724 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:48.502697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca\") pod \"3cfc8564-7e28-40b7-bb50-20d45cb6ab44\" (UID: \"3cfc8564-7e28-40b7-bb50-20d45cb6ab44\") "
Jul 30 21:02:48.503048 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:48.503024    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3cfc8564-7e28-40b7-bb50-20d45cb6ab44" (UID: "3cfc8564-7e28-40b7-bb50-20d45cb6ab44"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:02:48.603482 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:48.603422    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cfc8564-7e28-40b7-bb50-20d45cb6ab44-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:02:49.318920 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:49.318893    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"
Jul 30 21:02:49.318920 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:49.318903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622" event={"ID":"3cfc8564-7e28-40b7-bb50-20d45cb6ab44","Type":"ContainerDied","Data":"fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b"}
Jul 30 21:02:49.319113 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:49.318946    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb481e407e7757f05eb82ea2048a5c95aee167ed6334ab46c636edc2d6efd58b"
Jul 30 21:02:56.838511 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:56.838476    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"]
Jul 30 21:02:56.841529 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:56.841506    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-577a5369-qg622"]
Jul 30 21:02:57.258123 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:02:57.258030    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cfc8564-7e28-40b7-bb50-20d45cb6ab44" path="/var/lib/kubelet/pods/3cfc8564-7e28-40b7-bb50-20d45cb6ab44/volumes"
Jul 30 21:03:03.233710 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:03.233675    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:03:03.234226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:03.233949    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" containerID="cri-o://233ef1906e5e70eea6a85d73e1321fbc6bdcc9c3c3270be0b20b5230d65a8064" gracePeriod=30
Jul 30 21:03:04.198841 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:04.198795    2560 patch_prober.go:28] interesting pod/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:03:04.199008 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:04.198862    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:03:08.409507 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.409477    2560 generic.go:356] "Generic (PLEG): container finished" podID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerID="233ef1906e5e70eea6a85d73e1321fbc6bdcc9c3c3270be0b20b5230d65a8064" exitCode=0
Jul 30 21:03:08.409873 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.409568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerDied","Data":"233ef1906e5e70eea6a85d73e1321fbc6bdcc9c3c3270be0b20b5230d65a8064"}
Jul 30 21:03:08.409873 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.409635    2560 scope.go:117] "RemoveContainer" containerID="c4b19a2b6fbceb4dd65a4a217745ac4439ca5cd2708ef7e44505997a202aa512"
Jul 30 21:03:08.466582 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.466558    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:03:08.564839 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.564772    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.564990 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.564856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.564994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j84st\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565029    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565108    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565238 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:08.565238 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565238 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565199    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565238 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565222    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs\") pod \"c44737ba-bf42-4d11-9896-2386aa2fe28b\" (UID: \"c44737ba-bf42-4d11-9896-2386aa2fe28b\") "
Jul 30 21:03:08.565497 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565478    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.565567 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565491    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:08.565567 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565503    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:08.565704 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:08.565747 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.565720    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:03:08.566929 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.566900    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:03:08.567419 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.567400    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:03:08.567419 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.567409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:08.567549 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.567410    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st" (OuterVolumeSpecName: "kube-api-access-j84st") pod "c44737ba-bf42-4d11-9896-2386aa2fe28b" (UID: "c44737ba-bf42-4d11-9896-2386aa2fe28b"). InnerVolumeSpecName "kube-api-access-j84st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:03:08.666580 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666558    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666585    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c44737ba-bf42-4d11-9896-2386aa2fe28b-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666595    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666604    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666612    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j84st\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-kube-api-access-j84st\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666621    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666630    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:08.666678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:08.666638    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c44737ba-bf42-4d11-9896-2386aa2fe28b-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:03:09.421181 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:09.421146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv" event={"ID":"c44737ba-bf42-4d11-9896-2386aa2fe28b","Type":"ContainerDied","Data":"fe39e694a41e43314012740ba5c99b65676b89850cfba27d6006dca1db7450fb"}
Jul 30 21:03:09.421181 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:09.421175    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"
Jul 30 21:03:09.421650 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:09.421242    2560 scope.go:117] "RemoveContainer" containerID="233ef1906e5e70eea6a85d73e1321fbc6bdcc9c3c3270be0b20b5230d65a8064"
Jul 30 21:03:09.439256 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:09.439232    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:03:09.443063 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:09.443040    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-577a5369-openshift-default-cb645b8f6-nfhtv"]
Jul 30 21:03:11.256057 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:03:11.256016    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" path="/var/lib/kubelet/pods/c44737ba-bf42-4d11-9896-2386aa2fe28b/volumes"
Jul 30 21:05:13.365113 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:13.365072    2560 scope.go:117] "RemoveContainer" containerID="51fb4491ace45e813539cde2d96788d0d906084db5a6f83de5176c6ccb7e704c"
Jul 30 21:05:19.094039 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094003    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094340    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094352    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094360    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfc8564-7e28-40b7-bb50-20d45cb6ab44" containerName="revoke-keys"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094366    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfc8564-7e28-40b7-bb50-20d45cb6ab44" containerName="revoke-keys"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094384    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094390    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094462    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cfc8564-7e28-40b7-bb50-20d45cb6ab44" containerName="revoke-keys"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094471    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.094471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.094477    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c44737ba-bf42-4d11-9896-2386aa2fe28b" containerName="istio-proxy"
Jul 30 21:05:19.098671 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.098653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.101089 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.101068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9e2107d7-openshift-default-dockercfg-k7xnd\""
Jul 30 21:05:19.108628 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.108606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:05:19.143858 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.143836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.143965 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.143862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdgs\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.143965 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.143886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.143965 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.143910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.144081 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.143999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.144081 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.144059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.144081 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.144074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.144199 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.144099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.144199 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.144116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245495 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.245698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdgs\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246098 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.245711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246098 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.246060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246266 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.246233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.246308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246400 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.246379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.246546 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.246524    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.248063 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.248043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.248437 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.248420    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.252979 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.252950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.253520 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.253502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdgs\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs\") pod \"e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") " pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.409428 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.409359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:19.545494 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.545468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:05:19.547203 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:05:19.547176    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128ed03f_4e4d_419f_aa1e_39718f171211.slice/crio-e8f3b00a1194bf2c8359782cc00e23137e0d2c3f178d985c6aaebfa3cba1d644 WatchSource:0}: Error finding container e8f3b00a1194bf2c8359782cc00e23137e0d2c3f178d985c6aaebfa3cba1d644: Status 404 returned error can't find the container with id e8f3b00a1194bf2c8359782cc00e23137e0d2c3f178d985c6aaebfa3cba1d644
Jul 30 21:05:19.549335 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.549293    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:19.549423 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.549382    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:19.549462 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:19.549443    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:20.002937 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:20.002903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerStarted","Data":"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"}
Jul 30 21:05:20.003109 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:20.002986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerStarted","Data":"e8f3b00a1194bf2c8359782cc00e23137e0d2c3f178d985c6aaebfa3cba1d644"}
Jul 30 21:05:20.021458 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:20.021399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podStartSLOduration=1.021385433 podStartE2EDuration="1.021385433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:05:20.020190709 +0000 UTC m=+2407.274530988" watchObservedRunningTime="2026-07-30 21:05:20.021385433 +0000 UTC m=+2407.275725702"
Jul 30 21:05:20.410365 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:20.410327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:20.415076 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:20.415053    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:21.007451 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:21.007417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:21.008284 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:21.008265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:36.008803 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.008739    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:36.009254 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.008829    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:36.076860 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.076823    2560 generic.go:356] "Generic (PLEG): container finished" podID="128ed03f-4e4d-419f-aa1e-39718f171211" containerID="62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047" exitCode=0
Jul 30 21:05:36.077026 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.076893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerDied","Data":"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"}
Jul 30 21:05:36.077277 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.077263    2560 scope.go:117] "RemoveContainer" containerID="62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"
Jul 30 21:05:36.078250 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.078219    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:36.078347 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.078305    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:36.078406 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:36.078377    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:05:37.084197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:37.084159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerStarted","Data":"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"}
Jul 30 21:05:37.410493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:37.410390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:37.410906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:37.410873    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:37.411041 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:37.410943    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:38.410595 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:38.410554    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:38.411127 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:38.410855    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:39.411223 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:39.411183    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:39.411693 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:39.411262    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:40.410023 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:40.409981    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:40.410298 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:40.410268    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:41.410087 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:41.410048    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 21:05:41.410690 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:41.410654    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 21:05:42.414991 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:42.414956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:42.415386 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:42.415220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:05:42.415898 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:05:42.415880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:06:13.382515 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:13.382479    2560 scope.go:117] "RemoveContainer" containerID="1b2065033ff67440d6d3b379f98d58927a0c7ebe9d40c9faa7ea000189cb8bbe"
Jul 30 21:06:13.390387 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:13.390366    2560 scope.go:117] "RemoveContainer" containerID="6e56c49090ce93f182135a215d6c5c54d6e459c7fa68bc1c6443f5660379fccf"
Jul 30 21:06:13.397574 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:13.397551    2560 scope.go:117] "RemoveContainer" containerID="1b6256211267b0526b919ca123d2ffc55fc144657bbf25d294b167ad16476848"
Jul 30 21:06:31.858270 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.858230    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"]
Jul 30 21:06:31.860679 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.860657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:31.863434 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.863412    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:06:31.863549 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.863446    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:06:31.869075 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.869053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"]
Jul 30 21:06:31.978124 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:31.978086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj\" (UID: \"5fc54201-be29-4c42-bbb9-76b0c1f1b735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:32.078972 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:32.078932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj\" (UID: \"5fc54201-be29-4c42-bbb9-76b0c1f1b735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:32.079544 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:32.079525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj\" (UID: \"5fc54201-be29-4c42-bbb9-76b0c1f1b735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:32.172131 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:32.172041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:32.302417 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:32.302385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"]
Jul 30 21:06:32.304570 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:06:32.304541    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc54201_be29_4c42_bbb9_76b0c1f1b735.slice/crio-5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4 WatchSource:0}: Error finding container 5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4: Status 404 returned error can't find the container with id 5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4
Jul 30 21:06:32.353641 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:32.353608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj" event={"ID":"5fc54201-be29-4c42-bbb9-76b0c1f1b735","Type":"ContainerStarted","Data":"5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4"}
Jul 30 21:06:33.359235 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:33.359199    2560 generic.go:356] "Generic (PLEG): container finished" podID="5fc54201-be29-4c42-bbb9-76b0c1f1b735" containerID="fcbcc6470e404d089a851a07f89a85afc61b251c9a6114627c8d6de97db985ef" exitCode=0
Jul 30 21:06:33.359606 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:33.359284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj" event={"ID":"5fc54201-be29-4c42-bbb9-76b0c1f1b735","Type":"ContainerDied","Data":"fcbcc6470e404d089a851a07f89a85afc61b251c9a6114627c8d6de97db985ef"}
Jul 30 21:06:34.492267 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:34.492237    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:34.601552 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:34.601525    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca\") pod \"5fc54201-be29-4c42-bbb9-76b0c1f1b735\" (UID: \"5fc54201-be29-4c42-bbb9-76b0c1f1b735\") "
Jul 30 21:06:34.601856 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:34.601835    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fc54201-be29-4c42-bbb9-76b0c1f1b735" (UID: "5fc54201-be29-4c42-bbb9-76b0c1f1b735"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:06:34.702177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:34.702115    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fc54201-be29-4c42-bbb9-76b0c1f1b735-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:06:35.370773 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:35.370748    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"
Jul 30 21:06:35.370962 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:35.370742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj" event={"ID":"5fc54201-be29-4c42-bbb9-76b0c1f1b735","Type":"ContainerDied","Data":"5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4"}
Jul 30 21:06:35.370962 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:35.370877    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5347bd07d9146db7b8fdb55dd26abb673beeb1ea3baac2dafe55a5d5e45a81b4"
Jul 30 21:06:47.595697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:47.595655    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"]
Jul 30 21:06:47.602983 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:47.602954    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e2107d7-d9pxj"]
Jul 30 21:06:49.256604 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:06:49.256569    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc54201-be29-4c42-bbb9-76b0c1f1b735" path="/var/lib/kubelet/pods/5fc54201-be29-4c42-bbb9-76b0c1f1b735/volumes"
Jul 30 21:07:52.938125 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:52.938079    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:07:52.938674 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:52.938382    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" containerID="cri-o://89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184" gracePeriod=30
Jul 30 21:07:57.417861 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:57.417815    2560 patch_prober.go:28] interesting pod/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:07:57.418343 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:57.417875    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:07:58.186537 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.186504    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:07:58.248563 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sdgs\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248563 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248501    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248563 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248528    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248586    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248604    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248647    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248687    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.248875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token\") pod \"128ed03f-4e4d-419f-aa1e-39718f171211\" (UID: \"128ed03f-4e4d-419f-aa1e-39718f171211\") "
Jul 30 21:07:58.249172 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:58.249172 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.248967    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:07:58.249172 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:58.249317 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:58.249317 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data" (OuterVolumeSpecName: "istio-data") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:58.249423 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249342    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128ed03f-4e4d-419f-aa1e-39718f171211-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.249423 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249361    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.249423 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249370    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.249423 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.249383    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.251018 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.250980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:07:58.251183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.251025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:07:58.251183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.251025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token" (OuterVolumeSpecName: "istio-token") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:07:58.251371 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.251341    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs" (OuterVolumeSpecName: "kube-api-access-2sdgs") pod "128ed03f-4e4d-419f-aa1e-39718f171211" (UID: "128ed03f-4e4d-419f-aa1e-39718f171211"). InnerVolumeSpecName "kube-api-access-2sdgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:07:58.350615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.350323    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.350615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.350365    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128ed03f-4e4d-419f-aa1e-39718f171211-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.350615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.350379    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.350615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.350393    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sdgs\" (UniqueName: \"kubernetes.io/projected/128ed03f-4e4d-419f-aa1e-39718f171211-kube-api-access-2sdgs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.350615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.350409    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128ed03f-4e4d-419f-aa1e-39718f171211-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:07:58.756214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.756172    2560 generic.go:356] "Generic (PLEG): container finished" podID="128ed03f-4e4d-419f-aa1e-39718f171211" containerID="89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184" exitCode=0
Jul 30 21:07:58.756644 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.756226    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"
Jul 30 21:07:58.756644 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.756263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerDied","Data":"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"}
Jul 30 21:07:58.756644 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.756327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2" event={"ID":"128ed03f-4e4d-419f-aa1e-39718f171211","Type":"ContainerDied","Data":"e8f3b00a1194bf2c8359782cc00e23137e0d2c3f178d985c6aaebfa3cba1d644"}
Jul 30 21:07:58.756644 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.756353    2560 scope.go:117] "RemoveContainer" containerID="89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"
Jul 30 21:07:58.766584 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.766562    2560 scope.go:117] "RemoveContainer" containerID="62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"
Jul 30 21:07:58.776120 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.775956    2560 scope.go:117] "RemoveContainer" containerID="89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"
Jul 30 21:07:58.776530 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:07:58.776408    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184\": container with ID starting with 89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184 not found: ID does not exist" containerID="89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"
Jul 30 21:07:58.776530 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.776453    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184"} err="failed to get container status \"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184\": rpc error: code = NotFound desc = could not find container \"89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184\": container with ID starting with 89d9485a8eb8af974b7fd6fd628dd7d5677cc788aa3ccc12c6f27e51dd056184 not found: ID does not exist"
Jul 30 21:07:58.776530 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.776482    2560 scope.go:117] "RemoveContainer" containerID="62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"
Jul 30 21:07:58.776854 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:07:58.776830    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047\": container with ID starting with 62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047 not found: ID does not exist" containerID="62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"
Jul 30 21:07:58.776959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.776857    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047"} err="failed to get container status \"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047\": rpc error: code = NotFound desc = could not find container \"62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047\": container with ID starting with 62fe5054cd89b190abe3aba86fbe9a78b5507ccbb37e7be014bc776bc14bf047 not found: ID does not exist"
Jul 30 21:07:58.778316 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.778291    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:07:58.782082 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:58.782047    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9e2107d7-openshift-default-5fdcfc8948-f2rs2"]
Jul 30 21:07:59.257082 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:07:59.257042    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" path="/var/lib/kubelet/pods/128ed03f-4e4d-419f-aa1e-39718f171211/volumes"
Jul 30 21:08:58.640448 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.640408    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.640932    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.640955    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.640975    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.640985    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.641012    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc54201-be29-4c42-bbb9-76b0c1f1b735" containerName="revoke-keys"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.641021    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc54201-be29-4c42-bbb9-76b0c1f1b735" containerName="revoke-keys"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.641099    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641111 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.641112    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="128ed03f-4e4d-419f-aa1e-39718f171211" containerName="istio-proxy"
Jul 30 21:08:58.641509 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.641123    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc54201-be29-4c42-bbb9-76b0c1f1b735" containerName="revoke-keys"
Jul 30 21:08:58.643088 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.643063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.645802 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.645755    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d59412-openshift-default-dockercfg-zn9jf\""
Jul 30 21:08:58.655615 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.655578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:08:58.808676 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65z7v\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.808904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.808906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65z7v\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910532 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910868 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910556    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910868 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.910868 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.911003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.910946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.911261 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.911238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.912831 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.912803    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.913224 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.913194    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.918526 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.918500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.918759 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.918736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65z7v\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v\") pod \"e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") " pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:58.955697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:58.955654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:08:59.101090 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:59.101058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:08:59.103609 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:08:59.103572    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1b585a_a5b1_4f68_8e45_544276f94663.slice/crio-8c00fa549a472360529e0528e538ebf3999e8cd0a00bdaaa8c7e98217323cdca WatchSource:0}: Error finding container 8c00fa549a472360529e0528e538ebf3999e8cd0a00bdaaa8c7e98217323cdca: Status 404 returned error can't find the container with id 8c00fa549a472360529e0528e538ebf3999e8cd0a00bdaaa8c7e98217323cdca
Jul 30 21:08:59.106327 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:59.106286    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:08:59.106459 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:59.106362    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:08:59.106459 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:08:59.106395    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:00.060210 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:00.060167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerStarted","Data":"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"}
Jul 30 21:09:00.060625 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:00.060273    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerStarted","Data":"8c00fa549a472360529e0528e538ebf3999e8cd0a00bdaaa8c7e98217323cdca"}
Jul 30 21:09:00.079438 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:00.079371    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podStartSLOduration=2.0793540679999998 podStartE2EDuration="2.079354068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:09:00.079149079 +0000 UTC m=+2627.333489370" watchObservedRunningTime="2026-07-30 21:09:00.079354068 +0000 UTC m=+2627.333694337"
Jul 30 21:09:00.956031 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:00.955987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:00.961481 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:00.961447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:01.064605 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:01.064569    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:01.065756 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:01.065729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:13.441800 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:13.441742    2560 scope.go:117] "RemoveContainer" containerID="f037db28fd49b05b9cacdcaf3755cd1790ab8ace8fcc22a4d5cd88b3294d19b8"
Jul 30 21:09:16.065627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.065584    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:16.066121 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.065660    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:16.148496 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.148456    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerID="cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a" exitCode=0
Jul 30 21:09:16.148660 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.148531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerDied","Data":"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"}
Jul 30 21:09:16.149038 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.149017    2560 scope.go:117] "RemoveContainer" containerID="cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"
Jul 30 21:09:16.150137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.150099    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:16.150268 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.150205    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:16.150338 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:16.150260    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:17.155450 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:17.155412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerStarted","Data":"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"}
Jul 30 21:09:17.956195 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:17.956140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:17.956538 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:17.956506    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:17.956669 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:17.956557    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:18.956294 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:18.956249    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:18.956708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:18.956327    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:19.957072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:19.957028    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:19.957526 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:19.957105    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:20.956442 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:20.956397    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:20.956669 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:20.956469    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:21.956242 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:21.956194    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 21:09:21.956643 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:21.956273    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 21:09:22.963680 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:22.963637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:22.964102 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:22.964023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:22.965025 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:22.964993    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:09:27.667628 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.667587    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:09:27.671391 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.671363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.673983 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.673956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3230ac-openshift-default-dockercfg-8ltsv\""
Jul 30 21:09:27.683899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.683862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:09:27.791505 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791505 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbm5\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.791947 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.791725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892251 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892251 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892544 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892544 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892544 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892697 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbm5\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.892942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.892929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.893059 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.893038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.893135 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.893109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.893241 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.893219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.894738 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.894716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.894907 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.894883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.905984 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.905941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbm5\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.908616 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.908587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token\") pod \"e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") " pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:27.983003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:27.982903    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:28.131471 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.131429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:09:28.137491 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:09:28.137451    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd93a3b_0a5e_4745_a8ff_547d12d3522a.slice/crio-05ac4d7885fee15519c8be3cbf305bbf93f3f76ccf713fcace6ac523e027e6b3 WatchSource:0}: Error finding container 05ac4d7885fee15519c8be3cbf305bbf93f3f76ccf713fcace6ac523e027e6b3: Status 404 returned error can't find the container with id 05ac4d7885fee15519c8be3cbf305bbf93f3f76ccf713fcace6ac523e027e6b3
Jul 30 21:09:28.139714 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.139673    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:28.139816 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.139743    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:28.139816 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.139772    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:28.211732 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.211683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerStarted","Data":"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"}
Jul 30 21:09:28.211941 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.211761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerStarted","Data":"05ac4d7885fee15519c8be3cbf305bbf93f3f76ccf713fcace6ac523e027e6b3"}
Jul 30 21:09:28.233161 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.233031    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podStartSLOduration=1.233010125 podStartE2EDuration="1.233010125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:09:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:09:28.231812951 +0000 UTC m=+2655.486153220" watchObservedRunningTime="2026-07-30 21:09:28.233010125 +0000 UTC m=+2655.487350394"
Jul 30 21:09:28.983504 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:28.983460    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:29.989575 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:29.989521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:30.220717 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:30.220684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:30.221935 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:30.221905    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:44.289458 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.289367    2560 generic.go:356] "Generic (PLEG): container finished" podID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerID="dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787" exitCode=0
Jul 30 21:09:44.289458 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.289442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerDied","Data":"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"}
Jul 30 21:09:44.289945 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.289932    2560 scope.go:117] "RemoveContainer" containerID="dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"
Jul 30 21:09:44.291088 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.291050    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:44.291197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.291134    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:44.291197 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:44.291171    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:09:45.221198 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:45.221158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:45.299684 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:45.299640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerStarted","Data":"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"}
Jul 30 21:09:45.983909 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:45.983862    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:45.985228 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:45.985200    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 30 21:09:45.985355 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:45.985251    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 30 21:09:46.984396 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:46.984353    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 30 21:09:46.984875 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:46.984415    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 30 21:09:47.984491 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:47.984441    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 30 21:09:47.985168 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:47.985123    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 30 21:09:48.983625 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:48.983585    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 30 21:09:48.983868 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:48.983658    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 30 21:09:49.984027 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:49.983987    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 30 21:09:49.984477 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:49.984064    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 30 21:09:50.987489 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:50.987457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:50.987990 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:50.987756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:09:50.988542 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:09:50.988524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:11:33.211760 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:33.211711    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:11:33.212336 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:33.211996    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" containerID="cri-o://629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2" gracePeriod=30
Jul 30 21:11:37.967289 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:37.967196    2560 patch_prober.go:28] interesting pod/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:11:37.967289 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:37.967266    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:11:38.477972 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.477889    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:11:38.520124 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520087    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520124 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520128    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520357 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520357 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65z7v\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520357 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520297    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520357 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520321    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520565 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520565 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520402    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520565 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520434    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket\") pod \"1d1b585a-a5b1-4f68-8e45-544276f94663\" (UID: \"1d1b585a-a5b1-4f68-8e45-544276f94663\") "
Jul 30 21:11:38.520728 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520647    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:38.520816 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520763    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.520881 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:11:38.520937 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520899    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:38.520994 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520936    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:38.521051 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.520989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:38.522636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.522595    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:38.522821 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.522663    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:38.522821 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.522661    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v" (OuterVolumeSpecName: "kube-api-access-65z7v") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "kube-api-access-65z7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:38.522929 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.522913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d1b585a-a5b1-4f68-8e45-544276f94663" (UID: "1d1b585a-a5b1-4f68-8e45-544276f94663"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:11:38.621454 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621400    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1b585a-a5b1-4f68-8e45-544276f94663-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621454 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621448    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621454 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621459    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621454 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621468    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621454 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621477    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621825 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621487    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1b585a-a5b1-4f68-8e45-544276f94663-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621825 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621494    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1b585a-a5b1-4f68-8e45-544276f94663-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.621825 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.621503    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65z7v\" (UniqueName: \"kubernetes.io/projected/1d1b585a-a5b1-4f68-8e45-544276f94663-kube-api-access-65z7v\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:38.858689 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.858646    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerID="629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2" exitCode=0
Jul 30 21:11:38.858879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.858701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"
Jul 30 21:11:38.858879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.858733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerDied","Data":"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"}
Jul 30 21:11:38.858879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.858835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26" event={"ID":"1d1b585a-a5b1-4f68-8e45-544276f94663","Type":"ContainerDied","Data":"8c00fa549a472360529e0528e538ebf3999e8cd0a00bdaaa8c7e98217323cdca"}
Jul 30 21:11:38.858879 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.858868    2560 scope.go:117] "RemoveContainer" containerID="629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"
Jul 30 21:11:38.868809 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.868772    2560 scope.go:117] "RemoveContainer" containerID="cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"
Jul 30 21:11:38.877734 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.877711    2560 scope.go:117] "RemoveContainer" containerID="629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"
Jul 30 21:11:38.878084 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:11:38.878064    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2\": container with ID starting with 629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2 not found: ID does not exist" containerID="629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"
Jul 30 21:11:38.878151 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.878094    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2"} err="failed to get container status \"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2\": rpc error: code = NotFound desc = could not find container \"629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2\": container with ID starting with 629b28a177e232bb8cf0aadd4c45d6f9fbd7a9e64a6618c74f41b0f2c5157ec2 not found: ID does not exist"
Jul 30 21:11:38.878151 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.878115    2560 scope.go:117] "RemoveContainer" containerID="cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"
Jul 30 21:11:38.878356 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:11:38.878341    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a\": container with ID starting with cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a not found: ID does not exist" containerID="cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"
Jul 30 21:11:38.878398 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.878360    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a"} err="failed to get container status \"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a\": rpc error: code = NotFound desc = could not find container \"cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a\": container with ID starting with cd11559335c115860825c1609ffd2ee25625e7be4b34cba737106d7ce429d59a not found: ID does not exist"
Jul 30 21:11:38.882245 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.882209    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:11:38.886067 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:38.886034    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d59412-openshift-default-857bd945d4-zgp26"]
Jul 30 21:11:39.256416 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:39.256326    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" path="/var/lib/kubelet/pods/1d1b585a-a5b1-4f68-8e45-544276f94663/volumes"
Jul 30 21:11:50.579885 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:50.579848    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:11:50.580354 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:50.580151    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" containerID="cri-o://905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48" gracePeriod=30
Jul 30 21:11:50.990768 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:50.990669    2560 patch_prober.go:28] interesting pod/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:11:50.990768 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:50.990744    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:11:51.481894 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.481856    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:11:51.482364 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.482340    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:11:51.482500 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.482365    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:11:51.482500 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.482430    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:11:51.482500 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.482440    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:11:51.482683 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.482542    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:11:51.487581 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.487552    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.490192 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.490159    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c6145d-openshift-default-dockercfg-gccbr\""
Jul 30 21:11:51.498168 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.498130    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:11:51.642543 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.643003 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.642864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq52n\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.743860 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.743860 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.743860 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.743973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq52n\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744139 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744479 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744479 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744479 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744423    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744479 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.744712 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.744693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.746362 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.746334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.746675 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.746654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.752311 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.752284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq52n\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.752311 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.752297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token\") pod \"e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") " pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.800574 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.800533    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:51.948198 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.948158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:11:51.951514 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:11:51.951483    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6eebd4_8830_4741_99e9_22f85b65a6b0.slice/crio-ff610c23667744f30751798b6bbbabdfb56423d6896b3d1f8aa4fb69d624f460 WatchSource:0}: Error finding container ff610c23667744f30751798b6bbbabdfb56423d6896b3d1f8aa4fb69d624f460: Status 404 returned error can't find the container with id ff610c23667744f30751798b6bbbabdfb56423d6896b3d1f8aa4fb69d624f460
Jul 30 21:11:51.953559 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.953526    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:11:51.953677 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.953602    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:11:51.953677 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:51.953629    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:11:52.927068 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:52.927033    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerStarted","Data":"32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863"}
Jul 30 21:11:52.927641 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:52.927086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerStarted","Data":"ff610c23667744f30751798b6bbbabdfb56423d6896b3d1f8aa4fb69d624f460"}
Jul 30 21:11:52.946718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:52.946660    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podStartSLOduration=1.946638125 podStartE2EDuration="1.946638125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:11:52.945550911 +0000 UTC m=+2800.199891181" watchObservedRunningTime="2026-07-30 21:11:52.946638125 +0000 UTC m=+2800.200978396"
Jul 30 21:11:53.800962 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:53.800922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:53.806274 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:53.806245    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:53.932642 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:53.932599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:53.933711 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:53.933682    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:11:55.828358 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.828324    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:11:55.942866 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.942748    2560 generic.go:356] "Generic (PLEG): container finished" podID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerID="905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48" exitCode=0
Jul 30 21:11:55.942866 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.942829    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"
Jul 30 21:11:55.942866 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.942834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerDied","Data":"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"}
Jul 30 21:11:55.943119 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.942892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58" event={"ID":"6cd93a3b-0a5e-4745-a8ff-547d12d3522a","Type":"ContainerDied","Data":"05ac4d7885fee15519c8be3cbf305bbf93f3f76ccf713fcace6ac523e027e6b3"}
Jul 30 21:11:55.943119 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.942918    2560 scope.go:117] "RemoveContainer" containerID="905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"
Jul 30 21:11:55.951811 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.951759    2560 scope.go:117] "RemoveContainer" containerID="dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"
Jul 30 21:11:55.960321 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.960300    2560 scope.go:117] "RemoveContainer" containerID="905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"
Jul 30 21:11:55.960674 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:11:55.960645    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48\": container with ID starting with 905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48 not found: ID does not exist" containerID="905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"
Jul 30 21:11:55.960749 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.960685    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48"} err="failed to get container status \"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48\": rpc error: code = NotFound desc = could not find container \"905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48\": container with ID starting with 905674fd641e040dec5cfad122c642ef0314e8b8f30809c705a232b0801c7a48 not found: ID does not exist"
Jul 30 21:11:55.960749 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.960706    2560 scope.go:117] "RemoveContainer" containerID="dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"
Jul 30 21:11:55.960987 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:11:55.960969    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787\": container with ID starting with dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787 not found: ID does not exist" containerID="dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"
Jul 30 21:11:55.961028 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.960996    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787"} err="failed to get container status \"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787\": rpc error: code = NotFound desc = could not find container \"dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787\": container with ID starting with dbc0a5f1160abeda58d34e9d56916c53d97f7e7c710096db79ff5c13a7e7a787 not found: ID does not exist"
Jul 30 21:11:55.987367 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987539 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987539 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987539 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987479    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987539 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987500    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhbm5\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987539 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987878 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987574    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987878 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987622    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987878 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987647    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket\") pod \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\" (UID: \"6cd93a3b-0a5e-4745-a8ff-547d12d3522a\") "
Jul 30 21:11:55.987878 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:55.988072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987982    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:55.988072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.987998    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:55.988072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.988027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:11:55.988272 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.988245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:55.988444 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.988411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:55.990061 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.990028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5" (OuterVolumeSpecName: "kube-api-access-lhbm5") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "kube-api-access-lhbm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:55.990468 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.990439    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:55.990468 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.990449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:11:55.990629 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:55.990446    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cd93a3b-0a5e-4745-a8ff-547d12d3522a" (UID: "6cd93a3b-0a5e-4745-a8ff-547d12d3522a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:56.089572 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089528    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089572 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089571    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089572 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089594    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089607    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhbm5\" (UniqueName: \"kubernetes.io/projected/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-kube-api-access-lhbm5\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089621    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089634    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089647    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.089906 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.089661    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd93a3b-0a5e-4745-a8ff-547d12d3522a-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:11:56.266397 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.266353    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:11:56.269392 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:56.269331    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3230ac-openshift-default-69b5998648-9kf58"]
Jul 30 21:11:57.257240 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:11:57.257207    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" path="/var/lib/kubelet/pods/6cd93a3b-0a5e-4745-a8ff-547d12d3522a/volumes"
Jul 30 21:12:08.934342 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:08.934244    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:08.934888 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:08.934325    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:09.008256 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.008216    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerID="32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863" exitCode=0
Jul 30 21:12:09.008487 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.008298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerDied","Data":"32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863"}
Jul 30 21:12:09.008806 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.008770    2560 scope.go:117] "RemoveContainer" containerID="32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863"
Jul 30 21:12:09.010039 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.010006    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:09.010144 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.010104    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:09.010209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:09.010157    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:10.024482 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:10.024437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerStarted","Data":"bfd8fc7debf7f2255442df1eabd3f0eb22b676b755fb20170f3fd059762c1362"}
Jul 30 21:12:10.801078 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:10.801030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:12:10.801316 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:10.801181    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:10.801316 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:10.801235    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:11.801717 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:11.801674    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:11.802388 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:11.802346    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:12.801907 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:12.801856    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:12.802457 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:12.801945    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:13.802832 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:13.802698    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:13.802832 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:13.802811    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:14.801993 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:14.801950    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 21:12:14.802840 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:14.802330    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 21:12:15.805485 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:15.805433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:12:15.806002 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:15.805981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:12:15.806913 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:15.806892    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:12:20.669961 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.669924    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:12:20.671028 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671000    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.671221 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671208    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.671333 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671321    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.671411 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671403    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.671583 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671572    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.671671 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671661    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1b585a-a5b1-4f68-8e45-544276f94663" containerName="istio-proxy"
Jul 30 21:12:20.671748 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.671739    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd93a3b-0a5e-4745-a8ff-547d12d3522a" containerName="istio-proxy"
Jul 30 21:12:20.675226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.675197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.677761 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.677727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-039a87-openshift-default-dockercfg-hgr29\""
Jul 30 21:12:20.688414 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.687123    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:12:20.723056 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723260 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723260 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723260 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723396 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723396 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723396 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723510 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.723556 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.723507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f75wm\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.824758 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.824758 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f75wm\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.824975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825086 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825555 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.825922 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.825829    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.827375 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.827351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.827830 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.827775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.832855 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.832818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.833041 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.833018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f75wm\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm\") pod \"e2e-api-b-039a87-openshift-default-7cd584cc74-462q2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") " pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:20.991702 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:20.991598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:21.139071 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:21.139040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:12:21.141343 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:12:21.141303    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b34678_85d0_40c9_83dc_e8e3f79d56d2.slice/crio-6e082f7892d2f09423fb2b714f4cbbbf2ef30951a5562064fe443b73b40578c5 WatchSource:0}: Error finding container 6e082f7892d2f09423fb2b714f4cbbbf2ef30951a5562064fe443b73b40578c5: Status 404 returned error can't find the container with id 6e082f7892d2f09423fb2b714f4cbbbf2ef30951a5562064fe443b73b40578c5
Jul 30 21:12:21.143660 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:21.143620    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:21.143770 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:21.143696    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:21.143770 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:21.143732    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:22.090282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:22.090244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerStarted","Data":"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"}
Jul 30 21:12:22.090687 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:22.090307    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerStarted","Data":"6e082f7892d2f09423fb2b714f4cbbbf2ef30951a5562064fe443b73b40578c5"}
Jul 30 21:12:22.111119 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:22.111059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podStartSLOduration=2.111041962 podStartE2EDuration="2.111041962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:12:22.108871995 +0000 UTC m=+2829.363212262" watchObservedRunningTime="2026-07-30 21:12:22.111041962 +0000 UTC m=+2829.365382232"
Jul 30 21:12:22.991882 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:22.991835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:22.997185 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:22.997151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:23.095737 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:23.095701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:23.096752 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:23.096731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:38.097868 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.097832    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:38.098295 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.097900    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:38.177338 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.177302    2560 generic.go:356] "Generic (PLEG): container finished" podID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerID="2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5" exitCode=0
Jul 30 21:12:38.177531 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.177378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerDied","Data":"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"}
Jul 30 21:12:38.177923 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.177903    2560 scope.go:117] "RemoveContainer" containerID="2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"
Jul 30 21:12:38.179128 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.179093    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:38.179226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.179169    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:38.179226 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:38.179210    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:12:39.184052 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:39.184015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerStarted","Data":"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"}
Jul 30 21:12:39.993324 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:39.992834    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:39.993324 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:39.992977    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:39.993324 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:39.993027    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:40.992338 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:40.992293    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:40.992894 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:40.992374    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:41.993109 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:41.993058    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:41.993685 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:41.993136    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:42.992569 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:42.992522    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:42.992815 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:42.992599    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:43.992746 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:43.992694    2560 patch_prober.go:28] interesting pod/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 30 21:12:43.993301 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:43.992794    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 30 21:12:44.997245 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:44.997206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:44.997752 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:44.997728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:12:44.998466 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:12:44.998444    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:13:13.492958 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:13.492872    2560 scope.go:117] "RemoveContainer" containerID="fcbcc6470e404d089a851a07f89a85afc61b251c9a6114627c8d6de97db985ef"
Jul 30 21:13:14.146101 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:14.146059    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:13:14.146406 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:14.146353    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" containerID="cri-o://bfd8fc7debf7f2255442df1eabd3f0eb22b676b755fb20170f3fd059762c1362" gracePeriod=30
Jul 30 21:13:15.809091 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:15.809042    2560 patch_prober.go:28] interesting pod/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:13:15.809577 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:15.809119    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:13:19.392732 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.392679    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerID="bfd8fc7debf7f2255442df1eabd3f0eb22b676b755fb20170f3fd059762c1362" exitCode=0
Jul 30 21:13:19.393189 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.392814    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerDied","Data":"bfd8fc7debf7f2255442df1eabd3f0eb22b676b755fb20170f3fd059762c1362"}
Jul 30 21:13:19.393189 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.392924    2560 scope.go:117] "RemoveContainer" containerID="32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863"
Jul 30 21:13:19.415951 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:13:19.415925    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863\": container with ID starting with 32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863 not found: ID does not exist" containerID="32660781df2e209f74bac41a0f713bb83660fa4ae547b8fd232370781c66b863"
Jul 30 21:13:19.419421 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.419389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:13:19.598462 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598462 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598505    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq52n\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598532    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598559    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598578    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598682    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598724    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo\") pod \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\" (UID: \"5c6eebd4-8830-4741-99e9-22f85b65a6b0\") "
Jul 30 21:13:19.598741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598731    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598875    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.598988    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.599131    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.599165    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.599182    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.599197    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.599209 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.599211    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.600913 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.600869    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n" (OuterVolumeSpecName: "kube-api-access-gq52n") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "kube-api-access-gq52n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:13:19.600913 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.600877    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:19.601121 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.600949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:13:19.601121 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.600977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c6eebd4-8830-4741-99e9-22f85b65a6b0" (UID: "5c6eebd4-8830-4741-99e9-22f85b65a6b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:13:19.700431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.700308    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.700431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.700353    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq52n\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-kube-api-access-gq52n\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.700431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.700370    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.700431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.700382    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:19.700431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:19.700395    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c6eebd4-8830-4741-99e9-22f85b65a6b0-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:20.398341 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:20.398308    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"
Jul 30 21:13:20.398907 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:20.398365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6" event={"ID":"5c6eebd4-8830-4741-99e9-22f85b65a6b0","Type":"ContainerDied","Data":"ff610c23667744f30751798b6bbbabdfb56423d6896b3d1f8aa4fb69d624f460"}
Jul 30 21:13:20.398907 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:20.398440    2560 scope.go:117] "RemoveContainer" containerID="bfd8fc7debf7f2255442df1eabd3f0eb22b676b755fb20170f3fd059762c1362"
Jul 30 21:13:20.421309 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:20.421275    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:13:20.424115 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:20.424079    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c6145d-openshift-default-559bc7b894-tl6q6"]
Jul 30 21:13:21.257448 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:21.257406    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" path="/var/lib/kubelet/pods/5c6eebd4-8830-4741-99e9-22f85b65a6b0/volumes"
Jul 30 21:13:36.441215 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:36.441171    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:13:36.441734 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:36.441400    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy" containerID="cri-o://80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182" gracePeriod=30
Jul 30 21:13:37.361232 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:13:37.361549 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361534    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.361549 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361549    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.361691 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361563    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.361691 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361570    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.361691 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361643    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.361691 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.361654    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6eebd4-8830-4741-99e9-22f85b65a6b0" containerName="istio-proxy"
Jul 30 21:13:37.364737 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.364710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.367447 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.367409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-155c1d-openshift-default-dockercfg-d8phd\""
Jul 30 21:13:37.377143 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.377106    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:13:37.460097 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460284    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.460627 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.460403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvzpw\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561017 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.560961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvzpw\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561214 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561493 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561656 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561656 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561746 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.561839 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.561769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.562055 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.562029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.563993 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.563965    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.564106 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.564028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.568996 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.568956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.569129 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.569055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvzpw\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw\") pod \"e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") " pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.676103 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.676005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:37.827087 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.827056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:13:37.829170 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:13:37.829133    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda112fefc_3405_4d7c_88c3_d91055f7a490.slice/crio-5eed316649ab23ffb2569e29b91eeb938cd62c3fa1bfd83256456e0779f32836 WatchSource:0}: Error finding container 5eed316649ab23ffb2569e29b91eeb938cd62c3fa1bfd83256456e0779f32836: Status 404 returned error can't find the container with id 5eed316649ab23ffb2569e29b91eeb938cd62c3fa1bfd83256456e0779f32836
Jul 30 21:13:37.831301 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.831263    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:37.831385 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.831334    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:37.831385 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:37.831363    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:38.497220 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:38.497181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerStarted","Data":"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"}
Jul 30 21:13:38.497643 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:38.497240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerStarted","Data":"5eed316649ab23ffb2569e29b91eeb938cd62c3fa1bfd83256456e0779f32836"}
Jul 30 21:13:38.517999 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:38.517935    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podStartSLOduration=1.517916188 podStartE2EDuration="1.517916188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:13:38.515924159 +0000 UTC m=+2905.770264432" watchObservedRunningTime="2026-07-30 21:13:38.517916188 +0000 UTC m=+2905.772256458"
Jul 30 21:13:38.676554 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:38.676514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:38.681728 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:38.681700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:39.502253 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:39.502219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:39.503256 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:39.503229    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:41.702917 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.702886    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:13:41.804181 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804181 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804181 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f75wm\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804252    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804313    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs\") pod \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\" (UID: \"32b34678-85d0-40c9-83dc-e8e3f79d56d2\") "
Jul 30 21:13:41.804769 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804525    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:13:41.804866 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:41.804958 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804928    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.805027 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.804962    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.805027 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.805004    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:41.805327 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.805192    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:41.805327 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.805027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:41.806977 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.806949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:13:41.807190 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.807165    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:13:41.807256 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.807169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm" (OuterVolumeSpecName: "kube-api-access-f75wm") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "kube-api-access-f75wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:13:41.807321 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.807297    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32b34678-85d0-40c9-83dc-e8e3f79d56d2" (UID: "32b34678-85d0-40c9-83dc-e8e3f79d56d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:13:41.905636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905577    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.905636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905626    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.905636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905637    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.905636 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905646    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.906072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905655    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.906072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905664    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:41.906072 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:41.905672    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f75wm\" (UniqueName: \"kubernetes.io/projected/32b34678-85d0-40c9-83dc-e8e3f79d56d2-kube-api-access-f75wm\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:13:42.518970 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.518929    2560 generic.go:356] "Generic (PLEG): container finished" podID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerID="80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182" exitCode=0
Jul 30 21:13:42.519126 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.518989    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"
Jul 30 21:13:42.519126 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.519008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerDied","Data":"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"}
Jul 30 21:13:42.519126 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.519068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2" event={"ID":"32b34678-85d0-40c9-83dc-e8e3f79d56d2","Type":"ContainerDied","Data":"6e082f7892d2f09423fb2b714f4cbbbf2ef30951a5562064fe443b73b40578c5"}
Jul 30 21:13:42.519126 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.519094    2560 scope.go:117] "RemoveContainer" containerID="80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"
Jul 30 21:13:42.529155 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.529127    2560 scope.go:117] "RemoveContainer" containerID="2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"
Jul 30 21:13:42.537916 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.537895    2560 scope.go:117] "RemoveContainer" containerID="80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"
Jul 30 21:13:42.538276 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:13:42.538255    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182\": container with ID starting with 80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182 not found: ID does not exist" containerID="80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"
Jul 30 21:13:42.538362 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.538284    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182"} err="failed to get container status \"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182\": rpc error: code = NotFound desc = could not find container \"80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182\": container with ID starting with 80d971851e140f6e2dae6470bf8bc99ffeb59049b370ecea50300699a1179182 not found: ID does not exist"
Jul 30 21:13:42.538362 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.538304    2560 scope.go:117] "RemoveContainer" containerID="2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"
Jul 30 21:13:42.538606 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:13:42.538582    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5\": container with ID starting with 2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5 not found: ID does not exist" containerID="2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"
Jul 30 21:13:42.538656 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.538617    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5"} err="failed to get container status \"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5\": rpc error: code = NotFound desc = could not find container \"2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5\": container with ID starting with 2e987411564cccf08f4c79365467ff257cd5cdea089f8bac963e71a8762aadf5 not found: ID does not exist"
Jul 30 21:13:42.541230 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.541199    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:13:42.544731 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:42.544698    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-039a87-openshift-default-7cd584cc74-462q2"]
Jul 30 21:13:43.256886 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:43.256847    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" path="/var/lib/kubelet/pods/32b34678-85d0-40c9-83dc-e8e3f79d56d2/volumes"
Jul 30 21:13:54.504362 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.504260    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:54.504362 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.504326    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:13:54.578067 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.578032    2560 generic.go:356] "Generic (PLEG): container finished" podID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerID="5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0" exitCode=0
Jul 30 21:13:54.578245 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.578111    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerDied","Data":"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"}
Jul 30 21:13:54.578569 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.578549    2560 scope.go:117] "RemoveContainer" containerID="5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"
Jul 30 21:13:54.579722 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.579691    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:54.579834 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.579806    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:54.579904 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:54.579862    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:13:55.585464 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:55.585423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerStarted","Data":"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"}
Jul 30 21:13:55.676593 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:55.676546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:13:55.676865 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:55.676839    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:55.676920 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:55.676899    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:13:56.676993 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:56.676951    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:56.677414 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:56.677021    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:13:57.677235 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:57.677197    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:57.677661 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:57.677272    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:13:58.677314 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:58.677276    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:58.677728 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:58.677340    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:13:59.676856 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:59.676818    2560 patch_prober.go:28] interesting pod/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 30 21:13:59.677051 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:13:59.676880    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 30 21:14:00.681650 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:00.681614    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:14:00.682140 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:00.681980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:14:00.682823 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:00.682802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:14:06.084506 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.084465    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:14:06.085026 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.085007    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:14:06.085026 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.085025    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:14:06.085145 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.085054    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:14:06.085145 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.085063    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:14:06.085245 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.085146    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:14:06.087900 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.087873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.090597 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.090570    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-01bc1b-openshift-default-dockercfg-vhklt\""
Jul 30 21:14:06.100449 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.100421    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:14:06.141526 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141526 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141799 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141799 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141799 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141799 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fm5h\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141995 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141995 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.141995 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.141933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.242720 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.242667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.242720 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.242716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.242720 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.242736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243093 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.242755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243093 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.242962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243093 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fm5h\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243093 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243319 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243319 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243319 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243475 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243475 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243586 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.243586 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.243577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.245312 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.245294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.245609 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.245590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.251041 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.251008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.251165 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.251120    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fm5h\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h\") pod \"e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") " pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.401678 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.401571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:06.553734 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.553705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:14:06.556194 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:14:06.556162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5347686b_c27b_4cf1_bb99_82100ee6abcd.slice/crio-cbbfdb189d3d3365f45b7d9a93fb7fe7f2412236801e84577e133bcc2994c4ef WatchSource:0}: Error finding container cbbfdb189d3d3365f45b7d9a93fb7fe7f2412236801e84577e133bcc2994c4ef: Status 404 returned error can't find the container with id cbbfdb189d3d3365f45b7d9a93fb7fe7f2412236801e84577e133bcc2994c4ef
Jul 30 21:14:06.558772 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.558739    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:06.558885 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.558825    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:06.558885 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.558858    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:06.652126 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.652024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerStarted","Data":"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"}
Jul 30 21:14:06.652298 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.652130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerStarted","Data":"cbbfdb189d3d3365f45b7d9a93fb7fe7f2412236801e84577e133bcc2994c4ef"}
Jul 30 21:14:06.675733 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:06.675662    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podStartSLOduration=0.675639271 podStartE2EDuration="675.639271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:14:06.672545025 +0000 UTC m=+2933.926885296" watchObservedRunningTime="2026-07-30 21:14:06.675639271 +0000 UTC m=+2933.929979542"
Jul 30 21:14:07.402580 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:07.402532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:07.407903 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:07.407869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:07.657167 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:07.657073    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:07.658173 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:07.658143    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:22.658832 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.658777    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:22.659383 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.658854    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:22.740120 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.740084    2560 generic.go:356] "Generic (PLEG): container finished" podID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerID="623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d" exitCode=0
Jul 30 21:14:22.740319 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.740166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerDied","Data":"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"}
Jul 30 21:14:22.740634 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.740618    2560 scope.go:117] "RemoveContainer" containerID="623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"
Jul 30 21:14:22.741831 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.741797    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:22.741964 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.741868    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:22.741964 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:22.741902    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:14:23.746825 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:23.746769    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerStarted","Data":"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"}
Jul 30 21:14:24.402693 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:24.402651    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:24.403123 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:24.403095    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:24.403344 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:24.403293    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:25.402383 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:25.402330    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:25.402954 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:25.402415    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:26.403031 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:26.402986    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:26.403675 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:26.403640    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:27.402544 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:27.402499    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:27.402891 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:27.402851    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:28.403101 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:28.403052    2560 patch_prober.go:28] interesting pod/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 21:14:28.403754 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:28.403715    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 21:14:29.406711 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:29.406670    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:29.407198 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:29.406968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:14:29.407683 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:14:29.407664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:23:00.935984 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:00.935942    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:23:00.936563 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:00.936540    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b34678-85d0-40c9-83dc-e8e3f79d56d2" containerName="istio-proxy"
Jul 30 21:23:00.939845 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:00.939815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:00.943626 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:00.943597    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e54afd-openshift-default-dockercfg-ckhp5\""
Jul 30 21:23:00.956141 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:00.956103    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.030961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.031003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.031137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.031027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9js\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.131799 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132024 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.131989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9js\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132427 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.132073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132427 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.132181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132427 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.132298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132427 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.132334    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.132648 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.132561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.133100 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.133072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.134457 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.134424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.134768 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.134747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.141733 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.141694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.141891 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.141822    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9js\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js\") pod \"e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") " pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.250706 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.250603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:01.410201 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.410163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:23:01.412043 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:23:01.412011    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87459797_ebb8_4bdc_945a_ee94cf781530.slice/crio-a609570210514aab0264e5ce9130d79a3fc78196225167acdf99a68446bf75a1 WatchSource:0}: Error finding container a609570210514aab0264e5ce9130d79a3fc78196225167acdf99a68446bf75a1: Status 404 returned error can't find the container with id a609570210514aab0264e5ce9130d79a3fc78196225167acdf99a68446bf75a1
Jul 30 21:23:01.414668 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.414632    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:01.414745 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.414707    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:01.414745 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:01.414734    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:02.224297 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:02.224252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerStarted","Data":"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"}
Jul 30 21:23:02.224752 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:02.224318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerStarted","Data":"a609570210514aab0264e5ce9130d79a3fc78196225167acdf99a68446bf75a1"}
Jul 30 21:23:02.246404 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:02.246347    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podStartSLOduration=2.246330677 podStartE2EDuration="2.246330677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:23:02.245466573 +0000 UTC m=+3469.499806869" watchObservedRunningTime="2026-07-30 21:23:02.246330677 +0000 UTC m=+3469.500670947"
Jul 30 21:23:02.250764 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:02.250732    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:02.256316 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:02.256282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:03.228912 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:03.228871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:03.229890 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:03.229869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:18.525458 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:18.525421    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:40608->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 30 21:23:18.525949 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:18.525497    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:40608->10.133.0.47:15021: read: connection reset by peer"
Jul 30 21:23:19.306940 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.306897    2560 generic.go:356] "Generic (PLEG): container finished" podID="87459797-ebb8-4bdc-945a-ee94cf781530" containerID="430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918" exitCode=0
Jul 30 21:23:19.307145 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.306970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerDied","Data":"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"}
Jul 30 21:23:19.307424 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.307403    2560 scope.go:117] "RemoveContainer" containerID="430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"
Jul 30 21:23:19.308561 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.308526    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:19.308657 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.308602    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:19.308657 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:19.308636    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:23:20.315518 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:20.315482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerStarted","Data":"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"}
Jul 30 21:23:21.251486 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:21.251433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:21.251843 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:21.251816    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 21:23:21.251918 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:21.251894    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 21:23:22.251174 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:22.251135    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 21:23:22.251591 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:22.251190    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 21:23:23.251377 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:23.251332    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 21:23:23.251810 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:23.251401    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 21:23:24.251440 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:24.251400    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 21:23:24.251880 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:24.251465    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 21:23:25.251830 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:25.251766    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 30 21:23:25.252231 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:25.251853    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 30 21:23:26.255166 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:26.255134    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:26.255673 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:26.255650    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:23:26.256517 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:23:26.256496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:25:09.438188 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.438097    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:09.441708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.441681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.444946 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.444918    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-83307c-openshift-default-dockercfg-vk5sj\""
Jul 30 21:25:09.456716 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.456679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:09.540846 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.540802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541157 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvv84\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541286 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541203    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541286 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541286 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541464 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541464 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541464 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.541628 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.541474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642614 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvv84\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.642864 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643254 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.642880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643254 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.643142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643254 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.643220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643407 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.643311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643407 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.643397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.643585 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.643553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.645282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.645253    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.645989 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.645964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.652071 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.652032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.652256 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.652227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvv84\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84\") pod \"e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") " pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.753120 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.753020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:09.908417 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.908386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:09.910278 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:25:09.910250    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44532dc1_e770_4889_aa98_a6d14537d140.slice/crio-43ae6cc7ffd9b526ba00a848c8ac12f844b464a90ccda09ff01e9d1eaf135e01 WatchSource:0}: Error finding container 43ae6cc7ffd9b526ba00a848c8ac12f844b464a90ccda09ff01e9d1eaf135e01: Status 404 returned error can't find the container with id 43ae6cc7ffd9b526ba00a848c8ac12f844b464a90ccda09ff01e9d1eaf135e01
Jul 30 21:25:09.912747 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.912706    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:09.912884 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.912816    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:09.912884 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:09.912852    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:10.856774 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:10.856734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerStarted","Data":"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"}
Jul 30 21:25:10.857141 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:10.856813    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerStarted","Data":"43ae6cc7ffd9b526ba00a848c8ac12f844b464a90ccda09ff01e9d1eaf135e01"}
Jul 30 21:25:10.908680 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:10.908615    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podStartSLOduration=1.908596934 podStartE2EDuration="1.908596934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:25:10.906737186 +0000 UTC m=+3598.161077457" watchObservedRunningTime="2026-07-30 21:25:10.908596934 +0000 UTC m=+3598.162937203"
Jul 30 21:25:11.753994 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:11.753946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:11.759746 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:11.759707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:11.861431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:11.861394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:11.862469 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:11.862451    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:27.901942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:27.901896    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 21:25:27.902328 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:27.901980    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 21:25:29.956409 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.956371    2560 generic.go:356] "Generic (PLEG): container finished" podID="44532dc1-e770-4889-aa98-a6d14537d140" containerID="b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd" exitCode=0
Jul 30 21:25:29.956946 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.956426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerDied","Data":"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"}
Jul 30 21:25:29.956946 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.956911    2560 scope.go:117] "RemoveContainer" containerID="b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"
Jul 30 21:25:29.958028 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.957990    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:29.958116 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.958061    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:29.958116 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:29.958093    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 21:25:30.963310 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:30.963275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerStarted","Data":"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"}
Jul 30 21:25:31.753752 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:31.753715    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:31.753945 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:31.753906    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 21:25:31.753993 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:31.753946    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 21:25:32.753821 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:32.753766    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 21:25:32.754202 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:32.753838    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 21:25:33.754299 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:33.754260    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 21:25:33.754748 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:33.754325    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 21:25:34.753543 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:34.753508    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 21:25:34.753699 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:34.753567    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 21:25:35.754061 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:35.754024    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 21:25:35.754431 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:35.754082    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 21:25:36.756742 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:36.756711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:36.757168 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:36.756998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:36.757545 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:36.757527    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:51.361462 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:51.361428    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:51.362075 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:51.361638    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" containerID="cri-o://a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead" gracePeriod=30
Jul 30 21:25:51.759741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:51.759656    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:25:51.759741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:51.759723    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:25:56.623090 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.623059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:56.704369 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704268    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvv84\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704369 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704321    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704369 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704350    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704661 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704661 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704470    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704661 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704661 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704532    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs\") pod \"44532dc1-e770-4889-aa98-a6d14537d140\" (UID: \"44532dc1-e770-4889-aa98-a6d14537d140\") "
Jul 30 21:25:56.704899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704717    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:25:56.704899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:25:56.704899 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.704874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data" (OuterVolumeSpecName: "istio-data") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:25:56.705171 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:25:56.705171 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:25:56.705282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705196    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.705282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705212    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.705282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705226    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.705282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705240    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44532dc1-e770-4889-aa98-a6d14537d140-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.705282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.705253    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.706810 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.706760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84" (OuterVolumeSpecName: "kube-api-access-mvv84") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "kube-api-access-mvv84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:25:56.707022 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.706999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:25:56.707167 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.707148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token" (OuterVolumeSpecName: "istio-token") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:25:56.707262 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.707243    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44532dc1-e770-4889-aa98-a6d14537d140" (UID: "44532dc1-e770-4889-aa98-a6d14537d140"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:25:56.805943 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.805899    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.805943 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.805931    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44532dc1-e770-4889-aa98-a6d14537d140-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.805943 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.805941    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvv84\" (UniqueName: \"kubernetes.io/projected/44532dc1-e770-4889-aa98-a6d14537d140-kube-api-access-mvv84\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:56.805943 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:56.805951    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44532dc1-e770-4889-aa98-a6d14537d140-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:25:57.085049 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.085010    2560 generic.go:356] "Generic (PLEG): container finished" podID="44532dc1-e770-4889-aa98-a6d14537d140" containerID="a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead" exitCode=0
Jul 30 21:25:57.085237 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.085065    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"
Jul 30 21:25:57.085237 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.085091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerDied","Data":"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"}
Jul 30 21:25:57.085237 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.085150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf" event={"ID":"44532dc1-e770-4889-aa98-a6d14537d140","Type":"ContainerDied","Data":"43ae6cc7ffd9b526ba00a848c8ac12f844b464a90ccda09ff01e9d1eaf135e01"}
Jul 30 21:25:57.085237 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.085173    2560 scope.go:117] "RemoveContainer" containerID="a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"
Jul 30 21:25:57.095658 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.095636    2560 scope.go:117] "RemoveContainer" containerID="b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"
Jul 30 21:25:57.105437 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.105412    2560 scope.go:117] "RemoveContainer" containerID="a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"
Jul 30 21:25:57.105863 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:25:57.105835    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead\": container with ID starting with a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead not found: ID does not exist" containerID="a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"
Jul 30 21:25:57.105945 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.105873    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead"} err="failed to get container status \"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead\": rpc error: code = NotFound desc = could not find container \"a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead\": container with ID starting with a6d58a6fb150db71d63338fb5339bb95b5550178c8a8a621246e60c01c486ead not found: ID does not exist"
Jul 30 21:25:57.105945 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.105895    2560 scope.go:117] "RemoveContainer" containerID="b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"
Jul 30 21:25:57.106212 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:25:57.106189    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd\": container with ID starting with b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd not found: ID does not exist" containerID="b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"
Jul 30 21:25:57.106273 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.106216    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd"} err="failed to get container status \"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd\": rpc error: code = NotFound desc = could not find container \"b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd\": container with ID starting with b6445ee9ddaf63ac333a99f94ad46b8254f8ea79cc79dbca71c6bd2ff44c0abd not found: ID does not exist"
Jul 30 21:25:57.112621 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.112585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:57.116359 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.116323    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-83307c-openshift-default-864f8bdd4-fktrf"]
Jul 30 21:25:57.257131 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:25:57.257088    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44532dc1-e770-4889-aa98-a6d14537d140" path="/var/lib/kubelet/pods/44532dc1-e770-4889-aa98-a6d14537d140/volumes"
Jul 30 21:26:59.606594 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.606545    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:26:59.607129 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.606807    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy" containerID="cri-o://fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798" gracePeriod=30
Jul 30 21:26:59.942942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.942822    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"]
Jul 30 21:26:59.943206 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.943190    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:26:59.943206 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.943204    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:26:59.943342 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.943226    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:26:59.943342 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.943231    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:26:59.943342 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.943284    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:26:59.945231 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.945206    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:26:59.948109 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.948081    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 21:26:59.948109 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.948100    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zm2hs\""
Jul 30 21:26:59.954761 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:26:59.954583    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"]
Jul 30 21:27:00.027075 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:00.027024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq\" (UID: \"a7e237df-6dc3-489b-a640-bffb486ba9bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:00.127722 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:00.127682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq\" (UID: \"a7e237df-6dc3-489b-a640-bffb486ba9bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:00.128426 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:00.128401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq\" (UID: \"a7e237df-6dc3-489b-a640-bffb486ba9bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:00.257543 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:00.257432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:00.403743 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:00.403699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"]
Jul 30 21:27:00.407357 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:27:00.407318    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e237df_6dc3_489b_a640_bffb486ba9bc.slice/crio-0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1 WatchSource:0}: Error finding container 0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1: Status 404 returned error can't find the container with id 0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1
Jul 30 21:27:01.402882 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:01.402844    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7e237df-6dc3-489b-a640-bffb486ba9bc" containerID="6b1e07a342a86c47c5eed79d1deea76890bb0a73f52ce1b581ce2beb53f396c0" exitCode=0
Jul 30 21:27:01.403286 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:01.402926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq" event={"ID":"a7e237df-6dc3-489b-a640-bffb486ba9bc","Type":"ContainerDied","Data":"6b1e07a342a86c47c5eed79d1deea76890bb0a73f52ce1b581ce2beb53f396c0"}
Jul 30 21:27:01.403286 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:01.402977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq" event={"ID":"a7e237df-6dc3-489b-a640-bffb486ba9bc","Type":"ContainerStarted","Data":"0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1"}
Jul 30 21:27:02.550704 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:02.550672    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:02.654307 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:02.654261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca\") pod \"a7e237df-6dc3-489b-a640-bffb486ba9bc\" (UID: \"a7e237df-6dc3-489b-a640-bffb486ba9bc\") "
Jul 30 21:27:02.654674 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:02.654645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7e237df-6dc3-489b-a640-bffb486ba9bc" (UID: "a7e237df-6dc3-489b-a640-bffb486ba9bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:02.755450 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:02.755365    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e237df-6dc3-489b-a640-bffb486ba9bc-maas-api-service-ca\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:03.413732 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:03.413702    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"
Jul 30 21:27:03.413942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:03.413696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq" event={"ID":"a7e237df-6dc3-489b-a640-bffb486ba9bc","Type":"ContainerDied","Data":"0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1"}
Jul 30 21:27:03.413942 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:03.413846    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f5320aadc3499f57eff6dd29f608a768039b2a032cc121c5a8999b6f90551b1"
Jul 30 21:27:04.865812 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.865721    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:27:04.975182 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975143    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975182 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975187    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9js\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975233    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975435 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975436    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.975863 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975525    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:04.975863 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975545    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:04.975863 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:04.975863 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975590    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data\") pod \"87459797-ebb8-4bdc-945a-ee94cf781530\" (UID: \"87459797-ebb8-4bdc-945a-ee94cf781530\") "
Jul 30 21:27:04.976069 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975857    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:04.976069 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.975998    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data" (OuterVolumeSpecName: "istio-data") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:04.976183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.976164    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:04.976228 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.976189    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:04.976228 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.976205    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:04.976228 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.976219    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87459797-ebb8-4bdc-945a-ee94cf781530-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:04.976338 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.976232    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:04.977588 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.977566    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js" (OuterVolumeSpecName: "kube-api-access-jr9js") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "kube-api-access-jr9js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:04.977842 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.977813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:27:04.978108 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.978092    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token" (OuterVolumeSpecName: "istio-token") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:04.978155 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:04.978111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87459797-ebb8-4bdc-945a-ee94cf781530" (UID: "87459797-ebb8-4bdc-945a-ee94cf781530"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:05.077374 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.077320    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87459797-ebb8-4bdc-945a-ee94cf781530-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:05.077374 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.077365    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr9js\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-kube-api-access-jr9js\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:05.077374 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.077379    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87459797-ebb8-4bdc-945a-ee94cf781530-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:05.077641 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.077390    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87459797-ebb8-4bdc-945a-ee94cf781530-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:05.425315 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.425276    2560 generic.go:356] "Generic (PLEG): container finished" podID="87459797-ebb8-4bdc-945a-ee94cf781530" containerID="fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798" exitCode=0
Jul 30 21:27:05.425635 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.425335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"
Jul 30 21:27:05.425635 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.425366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerDied","Data":"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"}
Jul 30 21:27:05.425635 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.425430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7" event={"ID":"87459797-ebb8-4bdc-945a-ee94cf781530","Type":"ContainerDied","Data":"a609570210514aab0264e5ce9130d79a3fc78196225167acdf99a68446bf75a1"}
Jul 30 21:27:05.425635 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.425455    2560 scope.go:117] "RemoveContainer" containerID="fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"
Jul 30 21:27:05.435192 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.435170    2560 scope.go:117] "RemoveContainer" containerID="430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"
Jul 30 21:27:05.443060 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.443022    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:27:05.444888 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.444864    2560 scope.go:117] "RemoveContainer" containerID="fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"
Jul 30 21:27:05.445250 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:05.445227    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798\": container with ID starting with fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798 not found: ID does not exist" containerID="fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"
Jul 30 21:27:05.445350 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.445261    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798"} err="failed to get container status \"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798\": rpc error: code = NotFound desc = could not find container \"fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798\": container with ID starting with fa2a77337871c4a1cfa9d67ff94d7e2dc132247e117957fb451b2ac63fa28798 not found: ID does not exist"
Jul 30 21:27:05.445350 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.445284    2560 scope.go:117] "RemoveContainer" containerID="430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"
Jul 30 21:27:05.445584 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:05.445565    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918\": container with ID starting with 430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918 not found: ID does not exist" containerID="430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"
Jul 30 21:27:05.445635 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.445591    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918"} err="failed to get container status \"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918\": rpc error: code = NotFound desc = could not find container \"430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918\": container with ID starting with 430acb7659097c01f6ee27b7d1a4832263db7df67f3fdd51421c3ddd7525c918 not found: ID does not exist"
Jul 30 21:27:05.449175 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:05.449142    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e54afd-openshift-default-f8648f8d8-qpdh7"]
Jul 30 21:27:07.257450 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:07.257406    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" path="/var/lib/kubelet/pods/87459797-ebb8-4bdc-945a-ee94cf781530/volumes"
Jul 30 21:27:10.703276 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:10.703222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"]
Jul 30 21:27:10.706508 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:10.706472    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-296998-s4kdq"]
Jul 30 21:27:11.259076 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:11.259038    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e237df-6dc3-489b-a640-bffb486ba9bc" path="/var/lib/kubelet/pods/a7e237df-6dc3-489b-a640-bffb486ba9bc/volumes"
Jul 30 21:27:34.959103 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:34.958975    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:27:34.959579 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:34.959272    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy" containerID="cri-o://e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c" gracePeriod=30
Jul 30 21:27:40.236708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.236627    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:27:40.328459 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvzpw\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328459 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328465    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328529    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328621    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328645    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328692    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.328741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs\") pod \"a112fefc-3405-4d7c-88c3-d91055f7a490\" (UID: \"a112fefc-3405-4d7c-88c3-d91055f7a490\") "
Jul 30 21:27:40.329177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328950    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:40.329177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.328982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:40.329177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.329121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:40.329177 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.329138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:40.329394 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.329180    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a112fefc-3405-4d7c-88c3-d91055f7a490-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.329394 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.329203    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.329501 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.329405    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data" (OuterVolumeSpecName: "istio-data") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:40.331027 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.330995    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:27:40.331183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.331042    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:40.331183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.331116    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw" (OuterVolumeSpecName: "kube-api-access-kvzpw") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "kube-api-access-kvzpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:40.331183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.331147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token" (OuterVolumeSpecName: "istio-token") pod "a112fefc-3405-4d7c-88c3-d91055f7a490" (UID: "a112fefc-3405-4d7c-88c3-d91055f7a490"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:40.429775 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429736    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.429775 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429770    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.429775 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429795    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.430044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429804    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.430044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429814    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.430044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429822    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvzpw\" (UniqueName: \"kubernetes.io/projected/a112fefc-3405-4d7c-88c3-d91055f7a490-kube-api-access-kvzpw\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.430044 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.429831    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a112fefc-3405-4d7c-88c3-d91055f7a490-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:40.602757 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.602720    2560 generic.go:356] "Generic (PLEG): container finished" podID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerID="e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c" exitCode=0
Jul 30 21:27:40.602959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.602807    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"
Jul 30 21:27:40.602959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.602819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerDied","Data":"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"}
Jul 30 21:27:40.602959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.602878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj" event={"ID":"a112fefc-3405-4d7c-88c3-d91055f7a490","Type":"ContainerDied","Data":"5eed316649ab23ffb2569e29b91eeb938cd62c3fa1bfd83256456e0779f32836"}
Jul 30 21:27:40.602959 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.602907    2560 scope.go:117] "RemoveContainer" containerID="e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"
Jul 30 21:27:40.612698 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.612668    2560 scope.go:117] "RemoveContainer" containerID="5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"
Jul 30 21:27:40.622457 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.622428    2560 scope.go:117] "RemoveContainer" containerID="e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"
Jul 30 21:27:40.622850 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:40.622823    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c\": container with ID starting with e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c not found: ID does not exist" containerID="e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"
Jul 30 21:27:40.622931 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.622864    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c"} err="failed to get container status \"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c\": rpc error: code = NotFound desc = could not find container \"e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c\": container with ID starting with e81e41211d95253fedcf2d0e338c5b29eb303bede3d8f89ead8657f2ef20519c not found: ID does not exist"
Jul 30 21:27:40.622931 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.622891    2560 scope.go:117] "RemoveContainer" containerID="5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"
Jul 30 21:27:40.623488 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:40.623409    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0\": container with ID starting with 5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0 not found: ID does not exist" containerID="5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"
Jul 30 21:27:40.623631 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.623475    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0"} err="failed to get container status \"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0\": rpc error: code = NotFound desc = could not find container \"5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0\": container with ID starting with 5201c78a69315425a4d875e3fdd7dc6de2c8ca3c959a7ce7ec6ce9ed9f5130d0 not found: ID does not exist"
Jul 30 21:27:40.625719 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.625688    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:27:40.629977 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:40.629945    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-155c1d-openshift-default-d7b6d7d7b-6q9fj"]
Jul 30 21:27:41.257691 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:41.257652    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" path="/var/lib/kubelet/pods/a112fefc-3405-4d7c-88c3-d91055f7a490/volumes"
Jul 30 21:27:47.113613 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:47.113575    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:27:47.114124 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:47.113857    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy" containerID="cri-o://1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c" gracePeriod=30
Jul 30 21:27:52.366080 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.366046    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:27:52.440007 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.439908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440007 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.439968    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440007 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.439986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440036    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440159    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fm5h\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket\") pod \"5347686b-c27b-4cf1-bb99-82100ee6abcd\" (UID: \"5347686b-c27b-4cf1-bb99-82100ee6abcd\") "
Jul 30 21:27:52.440285 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:52.440665 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440397    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data" (OuterVolumeSpecName: "istio-data") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:52.440665 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440482    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:52.440665 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440542    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:27:52.440665 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440557    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-certs\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.440665 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440579    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-data\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.440932 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.440701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:52.442505 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.442475    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token" (OuterVolumeSpecName: "istio-token") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:52.442630 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.442498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:27:52.442630 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.442498    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h" (OuterVolumeSpecName: "kube-api-access-2fm5h") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "kube-api-access-2fm5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:27:52.442727 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.442702    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5347686b-c27b-4cf1-bb99-82100ee6abcd" (UID: "5347686b-c27b-4cf1-bb99-82100ee6abcd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:27:52.541204 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541163    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-token\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541204 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541195    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-envoy\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541204 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541207    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5347686b-c27b-4cf1-bb99-82100ee6abcd-istiod-ca-cert\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541204 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541216    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-credential-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541481 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541226    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5347686b-c27b-4cf1-bb99-82100ee6abcd-istio-podinfo\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541481 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541234    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fm5h\" (UniqueName: \"kubernetes.io/projected/5347686b-c27b-4cf1-bb99-82100ee6abcd-kube-api-access-2fm5h\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.541481 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.541243    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5347686b-c27b-4cf1-bb99-82100ee6abcd-workload-socket\") on node \"ip-10-0-139-183.ec2.internal\" DevicePath \"\""
Jul 30 21:27:52.668798 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.668750    2560 generic.go:356] "Generic (PLEG): container finished" podID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerID="1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c" exitCode=0
Jul 30 21:27:52.668982 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.668834    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"
Jul 30 21:27:52.668982 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.668838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerDied","Data":"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"}
Jul 30 21:27:52.668982 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.668963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd" event={"ID":"5347686b-c27b-4cf1-bb99-82100ee6abcd","Type":"ContainerDied","Data":"cbbfdb189d3d3365f45b7d9a93fb7fe7f2412236801e84577e133bcc2994c4ef"}
Jul 30 21:27:52.669103 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.668987    2560 scope.go:117] "RemoveContainer" containerID="1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"
Jul 30 21:27:52.678571 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.678547    2560 scope.go:117] "RemoveContainer" containerID="623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"
Jul 30 21:27:52.690294 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.690257    2560 scope.go:117] "RemoveContainer" containerID="1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"
Jul 30 21:27:52.690634 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:52.690613    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c\": container with ID starting with 1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c not found: ID does not exist" containerID="1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"
Jul 30 21:27:52.690708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.690645    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c"} err="failed to get container status \"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c\": rpc error: code = NotFound desc = could not find container \"1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c\": container with ID starting with 1d8581c3a3253557cfbca8a187d38c953259e7ffcbf4d591f26cd6bca5bd786c not found: ID does not exist"
Jul 30 21:27:52.690708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.690665    2560 scope.go:117] "RemoveContainer" containerID="623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"
Jul 30 21:27:52.690991 ip-10-0-139-183 kubenswrapper[2560]: E0730 21:27:52.690968    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d\": container with ID starting with 623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d not found: ID does not exist" containerID="623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"
Jul 30 21:27:52.691047 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.690998    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d"} err="failed to get container status \"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d\": rpc error: code = NotFound desc = could not find container \"623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d\": container with ID starting with 623bd898fb3bde0054d5047cf098baef4a6a650fbc143449a2d6fa4c960f340d not found: ID does not exist"
Jul 30 21:27:52.691354 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.691335    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:27:52.694233 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:52.694204    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-01bc1b-openshift-default-65c6f59964-r2ssd"]
Jul 30 21:27:53.257118 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:53.257073    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" path="/var/lib/kubelet/pods/5347686b-c27b-4cf1-bb99-82100ee6abcd/volumes"
Jul 30 21:27:53.297229 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:53.297193    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zc688_1adfa29a-0906-4b2a-acd5-57cc861e1807/manager/0.log"
Jul 30 21:27:53.420726 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:53.420690    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6hspb_d921ec20-dd60-48f8-a2dd-f5cf6acce3c9/manager/0.log"
Jul 30 21:27:53.553399 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:53.553281    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55bc447b6-qk2qs_dbc1dba9-df29-4be1-aca4-d8988f3239a1/manager/0.log"
Jul 30 21:27:54.152287 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:54.152256    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-zmp8p_1052640e-07b6-4db8-aa73-d5110709af2e/copy-manifests/0.log"
Jul 30 21:27:54.171330 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:54.171293    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-zmp8p_1052640e-07b6-4db8-aa73-d5110709af2e/manager/0.log"
Jul 30 21:27:54.749217 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:54.749183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757420-f68ht_c3cb731e-2dc3-4b02-8e5d-b97d99ebff4d/cleanup/0.log"
Jul 30 21:27:56.458032 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:56.457996    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-77gnd_b43f0d38-c208-43a4-8955-4896c4720a72/manager/0.log"
Jul 30 21:27:56.834340 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:56.834309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b_37c2ea8c-3fad-46af-88e1-502cd6d32bd7/istio-proxy/0.log"
Jul 30 21:27:57.320667 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:57.320620    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/1.log"
Jul 30 21:27:58.165752 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:58.165691    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d9zgn_f4fdaab4-d6f6-4555-b229-0199d9e1d821/main/0.log"
Jul 30 21:27:58.410505 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:27:58.410474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f88f6g_1c22b790-12b7-40e0-89a4-cd243447a641/main/0.log"
Jul 30 21:28:07.890449 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:07.890365    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jhdj9_b8f0531f-09e8-4d8d-b67f-669282e39a60/global-pull-secret-syncer/0.log"
Jul 30 21:28:08.022110 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:08.022075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rnl78_99a36f99-8f0f-44f9-84b6-b1c5948a32e4/konnectivity-agent/0.log"
Jul 30 21:28:08.069895 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:08.069865    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-183.ec2.internal_5d0a2f4ccd5d2e85c9491226551504c3/haproxy/0.log"
Jul 30 21:28:12.926264 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:12.926153    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-77gnd_b43f0d38-c208-43a4-8955-4896c4720a72/manager/0.log"
Jul 30 21:28:14.819381 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:14.819345    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6qkj_3fd813b5-76cc-492e-8356-300515724a6a/node-exporter/0.log"
Jul 30 21:28:14.840538 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:14.840503    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6qkj_3fd813b5-76cc-492e-8356-300515724a6a/kube-rbac-proxy/0.log"
Jul 30 21:28:14.864339 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:14.864251    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6qkj_3fd813b5-76cc-492e-8356-300515724a6a/init-textfile/0.log"
Jul 30 21:28:15.006995 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.006961    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/prometheus/0.log"
Jul 30 21:28:15.032583 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.032552    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/config-reloader/0.log"
Jul 30 21:28:15.086076 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.086039    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/thanos-sidecar/0.log"
Jul 30 21:28:15.160155 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.160076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/kube-rbac-proxy-web/0.log"
Jul 30 21:28:15.263523 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.263494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/kube-rbac-proxy/0.log"
Jul 30 21:28:15.297872 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.297838    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/kube-rbac-proxy-thanos/0.log"
Jul 30 21:28:15.323150 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:15.323099    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d2c8f0a6-7b62-4299-94fe-395bfa911b93/init-config-reloader/0.log"
Jul 30 21:28:18.541920 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.541874    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"]
Jul 30 21:28:18.542439 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542369    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.542439 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542390    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.542439 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542402    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e237df-6dc3-489b-a640-bffb486ba9bc" containerName="revoke-keys"
Jul 30 21:28:18.542439 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542410    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e237df-6dc3-489b-a640-bffb486ba9bc" containerName="revoke-keys"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542440    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542449    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542463    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542472    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542481    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542493    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542504    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542514    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542525    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542534    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542640    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="87459797-ebb8-4bdc-945a-ee94cf781530" containerName="istio-proxy"
Jul 30 21:28:18.542654 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542654    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.543269 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542662    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a112fefc-3405-4d7c-88c3-d91055f7a490" containerName="istio-proxy"
Jul 30 21:28:18.543269 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542672    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.543269 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542682    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e237df-6dc3-489b-a640-bffb486ba9bc" containerName="revoke-keys"
Jul 30 21:28:18.543269 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542692    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5347686b-c27b-4cf1-bb99-82100ee6abcd" containerName="istio-proxy"
Jul 30 21:28:18.543269 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.542701    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="44532dc1-e770-4889-aa98-a6d14537d140" containerName="istio-proxy"
Jul 30 21:28:18.545686 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.545657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.548437 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.548401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kzmr\"/\"kube-root-ca.crt\""
Jul 30 21:28:18.548603 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.548517    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kzmr\"/\"openshift-service-ca.crt\""
Jul 30 21:28:18.548603 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.548530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kzmr\"/\"default-dockercfg-xgkwf\""
Jul 30 21:28:18.555432 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.555396    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"]
Jul 30 21:28:18.580704 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.580654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-sys\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.580924 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.580721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-proc\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.580924 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.580856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwx7l\" (UniqueName: \"kubernetes.io/projected/0325c0a7-90c4-4b4a-b310-322e69c18600-kube-api-access-zwx7l\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.580924 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.580912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-podres\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.581102 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.580953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-lib-modules\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.681718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-podres\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.681718 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-lib-modules\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-sys\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-proc\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-lib-modules\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-podres\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-sys\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0325c0a7-90c4-4b4a-b310-322e69c18600-proc\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.682045 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.681921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwx7l\" (UniqueName: \"kubernetes.io/projected/0325c0a7-90c4-4b4a-b310-322e69c18600-kube-api-access-zwx7l\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.690344 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.690311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwx7l\" (UniqueName: \"kubernetes.io/projected/0325c0a7-90c4-4b4a-b310-322e69c18600-kube-api-access-zwx7l\") pod \"perf-node-gather-daemonset-56xkp\" (UID: \"0325c0a7-90c4-4b4a-b310-322e69c18600\") " pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.857417 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.857376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:18.998708 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:18.998679    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"]
Jul 30 21:28:19.001671 ip-10-0-139-183 kubenswrapper[2560]: W0730 21:28:19.001627    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0325c0a7_90c4_4b4a_b310_322e69c18600.slice/crio-5cbb5e800703a8b738b70264aa9ca0fab65abc4a818b31fb2a59d0d4d3e1e876 WatchSource:0}: Error finding container 5cbb5e800703a8b738b70264aa9ca0fab65abc4a818b31fb2a59d0d4d3e1e876: Status 404 returned error can't find the container with id 5cbb5e800703a8b738b70264aa9ca0fab65abc4a818b31fb2a59d0d4d3e1e876
Jul 30 21:28:19.797099 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:19.797058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp" event={"ID":"0325c0a7-90c4-4b4a-b310-322e69c18600","Type":"ContainerStarted","Data":"a92c8916d13e45e64af54e3c51dad3bbcecd0eb1e183dfba9e86cb8148c46f0a"}
Jul 30 21:28:19.797534 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:19.797121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp" event={"ID":"0325c0a7-90c4-4b4a-b310-322e69c18600","Type":"ContainerStarted","Data":"5cbb5e800703a8b738b70264aa9ca0fab65abc4a818b31fb2a59d0d4d3e1e876"}
Jul 30 21:28:19.797534 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:19.797247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:19.813429 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:19.813365    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp" podStartSLOduration=1.813345762 podStartE2EDuration="1.813345762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 21:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:28:19.811456629 +0000 UTC m=+3787.065796896" watchObservedRunningTime="2026-07-30 21:28:19.813345762 +0000 UTC m=+3787.067686031"
Jul 30 21:28:19.975251 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:19.975219    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2zdbc_0be27c3e-8ce8-4548-a810-66b01e3c7305/dns/0.log"
Jul 30 21:28:20.000570 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:20.000536    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2zdbc_0be27c3e-8ce8-4548-a810-66b01e3c7305/kube-rbac-proxy/0.log"
Jul 30 21:28:20.164141 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:20.164103    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8zvc_c488b145-121d-43e5-8b89-390ec20c90a9/dns-node-resolver/0.log"
Jul 30 21:28:20.683625 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:20.683583    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d55b55565-5nbc5_5b2e4457-04a5-42ed-adba-79f2fb5aad79/registry/0.log"
Jul 30 21:28:20.773955 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:20.773912    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q7g6v_9faef632-53f0-40ef-9668-5826ad553b50/node-ca/0.log"
Jul 30 21:28:21.678335 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:21.678291    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b_37c2ea8c-3fad-46af-88e1-502cd6d32bd7/istio-proxy/0.log"
Jul 30 21:28:21.919559 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:21.919525    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/0.log"
Jul 30 21:28:21.932924 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:21.932834    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/1.log"
Jul 30 21:28:22.835957 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:22.835913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gwwpv_cc7764aa-c457-43ec-b1dd-ed045fd6e707/serve-healthcheck-canary/0.log"
Jul 30 21:28:23.349394 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:23.349362    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kqh5n_d0a12310-3022-4591-a73f-214668a9db09/kube-rbac-proxy/0.log"
Jul 30 21:28:23.374403 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:23.374373    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kqh5n_d0a12310-3022-4591-a73f-214668a9db09/exporter/0.log"
Jul 30 21:28:23.400261 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:23.400229    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kqh5n_d0a12310-3022-4591-a73f-214668a9db09/extractor/0.log"
Jul 30 21:28:25.580566 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:25.580525    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zc688_1adfa29a-0906-4b2a-acd5-57cc861e1807/manager/0.log"
Jul 30 21:28:25.815213 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:25.815180    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kzmr/perf-node-gather-daemonset-56xkp"
Jul 30 21:28:26.012511 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:26.012416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6hspb_d921ec20-dd60-48f8-a2dd-f5cf6acce3c9/manager/0.log"
Jul 30 21:28:26.306516 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:26.306416    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55bc447b6-qk2qs_dbc1dba9-df29-4be1-aca4-d8988f3239a1/manager/0.log"
Jul 30 21:28:26.663183 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:26.663140    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-zmp8p_1052640e-07b6-4db8-aa73-d5110709af2e/manager/0.log"
Jul 30 21:28:26.681564 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:26.681526    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fd799f58b-zmp8p_1052640e-07b6-4db8-aa73-d5110709af2e/copy-manifests/0.log"
Jul 30 21:28:27.868180 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:27.868140    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b_37c2ea8c-3fad-46af-88e1-502cd6d32bd7/istio-proxy/0.log"
Jul 30 21:28:28.082282 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:28.082244    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/0.log"
Jul 30 21:28:28.088633 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:28.088543    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b6c8b8c96-vwjlv_9cc4dca8-1718-44a8-ad04-8a86c993031a/manager/0.log"
Jul 30 21:28:28.106310 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:28.106270    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/1.log"
Jul 30 21:28:29.583833 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:29.583774    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8j69b_37c2ea8c-3fad-46af-88e1-502cd6d32bd7/istio-proxy/0.log"
Jul 30 21:28:29.808668 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:29.808633    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/0.log"
Jul 30 21:28:29.821137 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:29.821043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w2tgm_2c178b4f-3134-429c-b8b5-1747d4de03a4/istio-proxy/1.log"
Jul 30 21:28:34.400823 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.400762    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2v8xr_7580ea94-a225-4dee-84bc-6cf34a513593/kube-multus/0.log"
Jul 30 21:28:34.587898 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.587868    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/kube-multus-additional-cni-plugins/0.log"
Jul 30 21:28:34.612776 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.612748    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/egress-router-binary-copy/0.log"
Jul 30 21:28:34.635741 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.635711    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/cni-plugins/0.log"
Jul 30 21:28:34.658117 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.658028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/bond-cni-plugin/0.log"
Jul 30 21:28:34.680534 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.680508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/routeoverride-cni/0.log"
Jul 30 21:28:34.704877 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.704837    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/whereabouts-cni-bincopy/0.log"
Jul 30 21:28:34.727643 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:34.727614    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6hqxj_04324dca-7997-4d87-8c7f-118d186a76ce/whereabouts-cni/0.log"
Jul 30 21:28:35.076997 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:35.076960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txtsm_6d3c8fce-3fb6-4f90-bc76-65faf3011d8a/network-metrics-daemon/0.log"
Jul 30 21:28:35.095957 ip-10-0-139-183 kubenswrapper[2560]: I0730 21:28:35.095927    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txtsm_6d3c8fce-3fb6-4f90-bc76-65faf3011d8a/kube-rbac-proxy/0.log"