Jul 27 20:32:52.228147 ip-10-0-140-195 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 20:32:52.228158 ip-10-0-140-195 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 20:32:52.228165 ip-10-0-140-195 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 20:32:52.228426 ip-10-0-140-195 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 20:33:02.455447 ip-10-0-140-195 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 20:33:02.455463 ip-10-0-140-195 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 471ace0b505b46eeada419d25378e6a6 --
Jul 27 20:35:01.274313 ip-10-0-140-195 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:35:01.685241 ip-10-0-140-195 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:35:01.685241 ip-10-0-140-195 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:35:01.685241 ip-10-0-140-195 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:35:01.685241 ip-10-0-140-195 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:35:01.685241 ip-10-0-140-195 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:35:01.690283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.690178    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:35:01.699068 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699047    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.699068 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699063    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.699068 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699067    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.699068 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699070    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.699068 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699073    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699076    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699079    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699081    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699084    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699086    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699089    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699092    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699094    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699097    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699099    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699102    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699105    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699108    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699111    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699114    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699116    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699119    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699122    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699124    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.699266 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699127    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699130    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699135    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699138    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699140    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699143    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699146    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699148    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699150    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699153    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699156    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699158    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699161    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699164    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699168    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699171    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699174    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699176    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699179    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699182    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.699734 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699184    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699188    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699193    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699195    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699198    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699201    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699204    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699207    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699209    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699212    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699215    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699217    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699220    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699222    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699225    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699228    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699230    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699233    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699235    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699238    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.700261 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699240    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699243    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699246    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699249    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699251    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699254    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699259    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699263    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699266    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699269    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699272    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699275    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699278    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699281    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699284    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699287    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699289    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699292    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699294    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.700741 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699298    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699300    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699304    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699306    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699310    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699312    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699315    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699318    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699320    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699323    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699325    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699328    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699330    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699333    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699335    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.699337    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700068    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700077    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700080    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700084    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.701236 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700087    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700090    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700092    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700095    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700097    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700100    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700103    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700106    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700108    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700111    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700113    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700116    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700118    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700122    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700127    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700130    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700133    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700137    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700140    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.701720 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700143    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700145    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700148    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700151    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700153    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700156    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700158    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700160    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700163    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700166    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700168    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700171    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700175    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700178    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700181    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700183    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700186    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700188    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700191    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700194    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.702196 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700196    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700198    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700201    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700203    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700206    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700209    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700212    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700215    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700217    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700220    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700223    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700225    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700227    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700230    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700232    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700235    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700237    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700240    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700242    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700245    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.702683 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700247    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700250    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700253    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700256    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700259    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700262    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700265    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700268    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700271    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700274    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700276    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700279    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700281    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700284    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700286    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700290    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700292    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700295    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700297    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.703207 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700301    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700305    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700308    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700311    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700313    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700317    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700320    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700322    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700325    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700328    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700331    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700334    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700336    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700339    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700342    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700345    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700348    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700698    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700704    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700707    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.703666 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700710    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700713    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700716    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700718    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700721    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700724    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700726    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700729    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700731    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700735    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700739    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700741    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700744    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700748    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700751    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700754    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700756    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700759    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700762    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.704165 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700764    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700767    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700770    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700772    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700775    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700777    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700780    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700782    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700787    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700790    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700793    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700796    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700799    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700802    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700804    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700816    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700820    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700822    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700825    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700828    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.704672 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700830    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700833    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700835    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700838    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700840    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700843    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700845    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700852    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700854    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700857    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700860    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700862    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700865    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700869    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700872    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700874    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700877    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700879    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700882    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700884    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.705191 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700887    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700889    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700892    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700894    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700897    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700899    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700902    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700904    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700907    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700909    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700912    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700916    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700918    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700920    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700923    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700925    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700928    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700930    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700933    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.705677 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700935    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700938    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700942    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700946    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700949    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700952    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700955    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700971    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700974    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700977    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700979    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700982    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700985    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700987    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700990    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700992    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700995    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.700997    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701065    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701076    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701082    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:35:01.706141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701086    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701090    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701093    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701097    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701101    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701104    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701107    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701110    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701113    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701116    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701119    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701122    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701127    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701131    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701134    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701139    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701141    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701146    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701149    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701153    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701156    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701159    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701162    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:35:01.706660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701165    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701168    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701171    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701174    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701177    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701180    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701187    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701190    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701192    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701195    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701198    2563 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701201    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701205    2563 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701208    2563 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701210    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701214    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701216    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701220    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701223    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701226    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701229    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701233    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701236    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701239    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701242    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:35:01.707211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701245    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701249    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701252    2563 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701256    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701259    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701262    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701265    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701268    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701271    2563 flags.go:64] FLAG: --help="false"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701274    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-195.ec2.internal"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701277    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701280    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701283    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701287    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701290    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701293    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701296    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701298    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701301    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701304    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701307    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701310    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701313    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701316    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:35:01.707851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701319    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701322    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701324    2563 flags.go:64] FLAG: --lock-file=""
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701327    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701331    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701334    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701339    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701343    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701346    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701349    2563 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701352    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701356    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701358    2563 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701361    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701365    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701368    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701372    2563 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701375    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701378    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701381    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701383    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701386    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701389    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701392    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701400    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:35:01.708478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701402    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701406    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701408    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701411    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701416    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701419    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701422    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701425    2563 flags.go:64] FLAG: --port="10250"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701428    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701431    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0704363da8509f424"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701434    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701437    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701440    2563 flags.go:64] FLAG: --register-node="true"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701443    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701447    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701450    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701454    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701457    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701461    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701464    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701467    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701469    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701472    2563 flags.go:64] FLAG: --runonce="false"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701475    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701479    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:35:01.709156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701481    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701484    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701487    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701490    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701493    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701496    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701498    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701501    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701504    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701507    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701510    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701513    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701515    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701520    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701523    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701526    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701531    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701533    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701536    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701540    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701543    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701546    2563 flags.go:64] FLAG: --v="2"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701549    2563 flags.go:64] FLAG: --version="false"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701554    2563 flags.go:64] FLAG: --vmodule=""
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701558    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:35:01.709762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.701561    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701670    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701674    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701677    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701680    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701682    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701685    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701688    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701690    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701693    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701695    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701698    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701700    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701703    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701705    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701708    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701712    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701715    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701718    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.710390 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701720    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701723    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701726    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701729    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701732    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701734    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701736    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701740    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701743    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701745    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701748    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701751    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701753    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701756    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701759    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701761    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701764    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701766    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701769    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701771    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.710847 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701774    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701777    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701781    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701784    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701786    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701789    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701791    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701794    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701796    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701799    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701801    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701804    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701806    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701809    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701811    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701814    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701816    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701819    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701821    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.711348 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701826    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701829    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701833    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701836    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701840    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701843    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701847    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701849    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701852    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701855    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701857    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701860    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701862    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701865    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701867    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701870    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701872    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701875    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701877    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701880    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.711801 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701882    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701885    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701887    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701890    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701892    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701895    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701897    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701899    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701902    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701904    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701907    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701909    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701913    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701915    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701918    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701920    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701925    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701928    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701930    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701933    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.712327 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701936    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.701938    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.703143    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710132    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710146    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710163    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710169    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710222    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710226    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710231    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710234    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710237    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710240    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710243    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710246    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.712817 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710249    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710252    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710255    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710257    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710260    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710263    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710265    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710268    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710270    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710273    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710276    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710279    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710282    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710284    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710287    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710290    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710293    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710295    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710298    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710301    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.713328 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710303    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710306    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710308    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710311    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710313    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710316    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710318    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710321    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710324    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710326    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710329    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710331    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710335    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710338    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710341    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710344    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710347    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710350    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710352    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.713804 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710355    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710358    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710360    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710363    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710366    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710368    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710371    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710374    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710376    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710379    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710382    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710385    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710388    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710390    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710393    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710396    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710398    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710401    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710404    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710406    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.714297 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710409    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710411    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710414    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710416    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710419    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710423    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710426    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710429    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710432    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710435    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710438    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710441    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710443    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710446    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710448    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710451    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710454    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710456    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710459    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.714788 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710461    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710464    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710466    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710469    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710472    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710474    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710477    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710479    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710482    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710484    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710487    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710491    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710494    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710500    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:35:01.715258 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710625    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710629    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710632    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710635    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710638    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710641    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710645    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710647    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710651    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710655    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710658    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710660    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710663    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710666    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710669    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710671    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710674    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710677    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710680    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:35:01.715638 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710682    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710685    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710687    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710690    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710693    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710695    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710698    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710700    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710703    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710705    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710708    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710710    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710712    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710715    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710717    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710720    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710722    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710725    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710728    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710730    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:35:01.716098 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710734    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710736    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710739    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710742    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710744    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710747    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710750    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710752    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710755    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710757    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710760    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710763    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710765    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710768    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710770    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710773    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710776    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710779    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710781    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:35:01.716584 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710783    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710786    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710788    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710791    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710793    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710796    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710798    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710800    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710803    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710805    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710808    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710810    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710812    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710815    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710817    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710820    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710822    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710824    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710827    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710829    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:35:01.717114 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710831    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710834    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710837    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710839    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710842    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710844    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710848    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710851    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710854    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710857    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710860    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710864    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710866    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710868    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710871    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710873    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710878    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710881    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710883    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:35:01.717620 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:01.710885    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710890    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.710996    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.712985    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.714175    2563 server.go:1019] "Starting client certificate rotation"
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.714272    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.714302    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:35:01.718126 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.717170    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:35:01.718368 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.718236    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:35:01.733274 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.733253    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:35:01.735535 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.735520    2563 log.go:25] "Validated CRI v1 image API"
Jul 27 20:35:01.736374 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.736354    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:35:01.739732 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.739709    2563 fs.go:135] Filesystem UUIDs: map[2f34d51e-73ed-4f03-b408-60e845329a09:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f99c153d-ae7e-43ae-9e1d-6ee4fb3c2112:/dev/nvme0n1p4]
Jul 27 20:35:01.739806 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.739731    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:35:01.742839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.742822    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:35:01.744839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.744715    2563 manager.go:216] Machine: {Timestamp:2026-07-27 20:35:01.743362438 +0000 UTC m=+0.347847303 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103701 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb319da95faf28539223554d61799 SystemUUID:ec2bb319-da95-faf2-8539-223554d61799 BootID:471ace0b-505b-46ee-ada4-19d25378e6a6 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:3e:46:26:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:3e:46:26:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:e1:69:f9:f6:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:35:01.744839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.744837    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:35:01.744972 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.744915    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:35:01.747997 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.747949    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:35:01.748134 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.748000    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:35:01.748721 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.748712    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:35:01.748751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.748724    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:35:01.748751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.748732    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:35:01.749316 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.749306    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:35:01.750450 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.750441    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:35:01.754029 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754018    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:35:01.754134 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754124    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:35:01.754173 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754153    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:35:01.754173 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754162    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:35:01.754232 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754176    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:35:01.754232 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754185    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:35:01.754232 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754194    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:35:01.754539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754528    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:35:01.754584 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.754545    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:35:01.756491 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.756476    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:35:01.757741 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.757728    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:35:01.757791 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.757759    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:35:01.758828 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758816    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:35:01.758861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758834    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:35:01.758861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758840    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:35:01.758861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758845    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:35:01.758861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758853    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:35:01.758861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758858    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758867    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758872    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758878    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758883    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758891    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:35:01.759037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.758896    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:35:01.759514 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.759505    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:35:01.759514 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.759514    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:35:01.762339 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.762314    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:35:01.762575 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.762561    2563 server.go:1268] "Started kubelet"
Jul 27 20:35:01.762694 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.762639    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:35:01.762768 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.762728    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:35:01.762817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.762782    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:35:01.762903 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.762880    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:35:01.763010 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.762879    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:35:01.763388 ip-10-0-140-195 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:35:01.764203 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.764190    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:35:01.764907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.764896    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:35:01.767340 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.766357    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhrqz"
Jul 27 20:35:01.770400 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.770203    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:35:01.770895 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.767700    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-195.ec2.internal.18c63fd89616b0c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-195.ec2.internal,UID:ip-10-0-140-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-195.ec2.internal,},FirstTimestamp:2026-07-27 20:35:01.762535621 +0000 UTC m=+0.367020485,LastTimestamp:2026-07-27 20:35:01.762535621 +0000 UTC m=+0.367020485,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-195.ec2.internal,}"
Jul 27 20:35:01.772984 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.772952    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhrqz"
Jul 27 20:35:01.777764 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.777545    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:35:01.777764 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.777553    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:35:01.777764 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.777717    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:01.778444 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778425    2563 factory.go:55] Registering systemd factory
Jul 27 20:35:01.778444 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778446    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:35:01.778607 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778454    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:35:01.778607 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778459    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:35:01.778607 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778475    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778646    2563 factory.go:153] Registering CRI-O factory
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778661    2563 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778708    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778712    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778717    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:35:01.778736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778733    2563 factory.go:103] Registering Raw factory
Jul 27 20:35:01.778923 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.778750    2563 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:35:01.779356 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.779334    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:35:01.779441 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.779425    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:35:01.779907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.779892    2563 manager.go:349] Starting recovery of all containers
Jul 27 20:35:01.790588 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.790571    2563 manager.go:354] Recovery completed
Jul 27 20:35:01.795172 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.795159    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:01.798017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.797995    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:01.798084 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798032    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:01.798084 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798042    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:01.798645 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798629    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:35:01.798645 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798644    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:35:01.798769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798647    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:01.798769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.798661    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:35:01.799366 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.799351    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:01.799430 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.799382    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:01.799430 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.799394    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:01.800673 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.800660    2563 policy_none.go:49] "None policy: Start"
Jul 27 20:35:01.800749 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.800677    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:35:01.800749 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.800690    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:35:01.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.802665    2563 policy_none.go:47] "Start"
Jul 27 20:35:01.835620 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.835507    2563 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:35:01.835705 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.835631    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:35:01.835705 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.835644    2563 server.go:87] "Starting device plugin registration server"
Jul 27 20:35:01.835878 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.835863    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:35:01.835932 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.835880    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:35:01.836051 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.836034    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:35:01.836136 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.836122    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:35:01.836136 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.836134    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:35:01.836520 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.836504    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:35:01.836598 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.836552    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:01.936369 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.936257    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:01.937287 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.937268    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:01.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.937310    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:01.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.937325    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:01.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.937366    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-195.ec2.internal"
Jul 27 20:35:01.945687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.945665    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-195.ec2.internal"
Jul 27 20:35:01.945778 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.945701    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-195.ec2.internal\": node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:01.964420 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.964392    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:01.974679 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.974654    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:35:01.976189 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.976163    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:35:01.976300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.976209    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:35:01.976300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.976238    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:35:01.976300 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:01.976281    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:35:01.978159 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:01.978143    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:02.065545 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.065494    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.076405 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.076377    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"]
Jul 27 20:35:02.076463 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.076447    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:02.077453 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.077426    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:02.077530 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.077467    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:02.077530 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.077479    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:02.079934 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.079919    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:02.079984 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.079941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2959093a1dac1f70892d700ea2e2faf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-195.ec2.internal\" (UID: \"c2959093a1dac1f70892d700ea2e2faf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.080073 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.080113 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080082    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:02.080790 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080776    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:02.080790 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080784    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:02.080862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080806    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:02.080862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080807    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:02.080862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080818    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:02.080862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.080822    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:02.083229 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.083215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.083291 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.083240    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:35:02.084020 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.084002    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:35:02.084121 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.084026    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:35:02.084121 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.084039    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:35:02.107726 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.107703    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-195.ec2.internal\" not found" node="ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.112525 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.112510    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-195.ec2.internal\" not found" node="ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.165997 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.165959    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.181086 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.181050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2959093a1dac1f70892d700ea2e2faf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-195.ec2.internal\" (UID: \"c2959093a1dac1f70892d700ea2e2faf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.181172 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.181096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.181172 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.181121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.181172 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.181155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2959093a1dac1f70892d700ea2e2faf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-195.ec2.internal\" (UID: \"c2959093a1dac1f70892d700ea2e2faf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.266560 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.266506    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.281401 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.281374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.281461 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.281405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.281461 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.281432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.281560 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.281466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60cd812551eeb1408b6dd40f619589bc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal\" (UID: \"60cd812551eeb1408b6dd40f619589bc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.373584 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.373555    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.411956 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.411937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.415777 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.415759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.475311 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.475288    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.577377 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.577288    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.678592 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.678550    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.691335 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.691315    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:02.714433 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.714410    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:35:02.714564 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.714546    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:35:02.714601 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.714583    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:35:02.779677 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:02.779654    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-195.ec2.internal\" not found"
Jul 27 20:35:02.781963 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.781940    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:30:02 +0000 UTC" deadline="2028-04-03 17:23:36.470713956 +0000 UTC"
Jul 27 20:35:02.782021 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.781978    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14780h48m33.688753896s"
Jul 27 20:35:02.805846 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.805823    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:02.878122 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.878052    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.888111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.888091    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:35:02.889110 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.889097    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal"
Jul 27 20:35:02.900765 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:02.900750    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:35:03.084748 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:03.084709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cd812551eeb1408b6dd40f619589bc.slice/crio-cf3834e5d75aba2f0629ff33d7bf7ddd204947c6400b349726257a683e4f5e31 WatchSource:0}: Error finding container cf3834e5d75aba2f0629ff33d7bf7ddd204947c6400b349726257a683e4f5e31: Status 404 returned error can't find the container with id cf3834e5d75aba2f0629ff33d7bf7ddd204947c6400b349726257a683e4f5e31
Jul 27 20:35:03.089661 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.089641    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:35:03.110322 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:03.110300    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2959093a1dac1f70892d700ea2e2faf.slice/crio-a389a5ba2b274c42ffdd02ed38982e2a9b1702961fe8eae8a3479be79529f2ff WatchSource:0}: Error finding container a389a5ba2b274c42ffdd02ed38982e2a9b1702961fe8eae8a3479be79529f2ff: Status 404 returned error can't find the container with id a389a5ba2b274c42ffdd02ed38982e2a9b1702961fe8eae8a3479be79529f2ff
Jul 27 20:35:03.195307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.195240    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:03.757482 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.757451    2563 apiserver.go:52] "Watching apiserver"
Jul 27 20:35:03.763732 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.763707    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:35:03.765146 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.765114    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mjwgc","kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal","openshift-dns/node-resolver-w9k6z","openshift-image-registry/node-ca-bxxvg","openshift-multus/multus-additional-cni-plugins-262cq","openshift-multus/network-metrics-daemon-wjv5r","openshift-network-diagnostics/network-check-target-fpmx8","openshift-ovn-kubernetes/ovnkube-node-ndw6k","kube-system/global-pull-secret-syncer-hrhdg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn","openshift-cluster-node-tuning-operator/tuned-4mj56","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal","openshift-multus/multus-2lbbg","openshift-network-operator/iptables-alerter-mmt6n"]
Jul 27 20:35:03.767786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.767763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:03.767883 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.767857    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:03.770252 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.770228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.772481    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.772711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.772834    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.772989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z2vk7\""
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.773067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:35:03.773362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.773309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.775038 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.775016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.778202 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.777503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pq2v\""
Jul 27 20:35:03.778317 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.778177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:35:03.778610 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.778574    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.780294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.778799    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.780294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.779245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.780294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.779581    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:35:03.780294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.779875    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mx4h5\""
Jul 27 20:35:03.780294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.780184    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.781516 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.781496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.783645 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.783619    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:35:03.783743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.783701    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:35:03.783874 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.783856    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjvtx\""
Jul 27 20:35:03.783949 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.783924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:03.784042 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.784005    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:03.786281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.786261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.786365 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.786326    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:03.788690 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.788667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:03.789827 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.789808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-os-release\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.789920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.789834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-system-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.789920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.789861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-cni-binary-copy\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.789920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.789887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7thng\" (UniqueName: \"kubernetes.io/projected/d8889fd1-0618-408e-be2b-7ff880f12d43-kube-api-access-7thng\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.789920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.789914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cnibin\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-multus\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-netns\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-kubelet\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g829\" (UniqueName: \"kubernetes.io/projected/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-kube-api-access-8g829\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmgt7\" (UniqueName: \"kubernetes.io/projected/910d687d-8698-4e16-85f1-701b47bc2e11-kube-api-access-vmgt7\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.790367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-multus-certs\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hlj\" (UniqueName: \"kubernetes.io/projected/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-kube-api-access-69hlj\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.790563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-cnibin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-socket-dir-parent\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-conf-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-etc-kubernetes\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-hostroot\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910d687d-8698-4e16-85f1-701b47bc2e11-host\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/910d687d-8698-4e16-85f1-701b47bc2e11-serviceca\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.790860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.791381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-os-release\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.791381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-k8s-cni-cncf-io\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.791381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:03.791636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791604    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:35:03.791739 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791684    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:35:03.791739 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791729    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:35:03.791851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791767    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k5jnc\""
Jul 27 20:35:03.791851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.790916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-bin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.791851 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-daemon-config\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.792040 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-hosts-file\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.792040 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.791883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-tmp-dir\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.793762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.793741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.794333 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.794035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.794333 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.794159    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:35:03.794333 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.794224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8jmkm\""
Jul 27 20:35:03.794522 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.794383    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.796447 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.796426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:35:03.796567 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.796544    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnlvr\""
Jul 27 20:35:03.796641 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.796585    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.796842 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.796826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.798049 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.798027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.800184 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.800154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.800550 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.800396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-465t8\""
Jul 27 20:35:03.800638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.800572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.800739 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.800722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.802765 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.802743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b8bx6\""
Jul 27 20:35:03.804593 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804573    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:35:03.804723 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:35:03.804769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:35:03.804866 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804834    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:35:03.804915 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:35:03.804976 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.804961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:35:03.822533 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.822509    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9c9g"
Jul 27 20:35:03.829007 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.828987    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9c9g"
Jul 27 20:35:03.836697 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.836542    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:03.879892 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.879863    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:35:03.892410 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5cq\" (UniqueName: \"kubernetes.io/projected/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kube-api-access-4g5cq\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.892517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g829\" (UniqueName: \"kubernetes.io/projected/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-kube-api-access-8g829\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.892517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-sys\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.892517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54de0569-bde8-4abf-9e79-9add0750da49-konnectivity-ca\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:03.892517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.892517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmgt7\" (UniqueName: \"kubernetes.io/projected/910d687d-8698-4e16-85f1-701b47bc2e11-kube-api-access-vmgt7\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-log-socket\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqrl\" (UniqueName: \"kubernetes.io/projected/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-kube-api-access-dvqrl\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54de0569-bde8-4abf-9e79-9add0750da49-agent-certs\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-cnibin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-socket-dir-parent\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-conf-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-cnibin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6gf\" (UniqueName: \"kubernetes.io/projected/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-kube-api-access-4b6gf\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-kubernetes\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-sys-fs\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-conf-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-conf\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.892788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-etc-tuned\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-systemd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-socket-dir-parent\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfng\" (UniqueName: \"kubernetes.io/projected/fc1fdc80-a99b-4741-81ac-8b9e047157a0-kube-api-access-tgfng\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-systemd\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.892983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-run\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-host\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4pp6\" (UniqueName: \"kubernetes.io/projected/e827a734-be1f-469c-82ce-999ffc77505a-kube-api-access-x4pp6\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-bin\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-kubelet-config\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-os-release\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-bin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-daemon-config\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-bin\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.893478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-os-release\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-tmp-dir\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-ovn\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-socket-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-device-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-system-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-kubelet\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-var-lib-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-dbus\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-modprobe-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-daemon-config\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-tmp-dir\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-system-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-tmp\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.894418 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-netns\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-kubelet\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.893981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-netd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-netns\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-kubelet\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-script-lib\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-multus-certs\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69hlj\" (UniqueName: \"kubernetes.io/projected/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-kube-api-access-69hlj\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-node-log\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-multus-certs\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-env-overrides\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-registration-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.895414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-config\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovn-node-metrics-cert\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-multus-cni-dir\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-etc-kubernetes\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-slash\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-etc-kubernetes\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-etc-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-hostroot\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910d687d-8698-4e16-85f1-701b47bc2e11-host\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/910d687d-8698-4e16-85f1-701b47bc2e11-serviceca\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-var-lib-kubelet\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-hostroot\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-systemd-units\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc1fdc80-a99b-4741-81ac-8b9e047157a0-host-slash\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/910d687d-8698-4e16-85f1-701b47bc2e11-host\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-k8s-cni-cncf-io\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-hosts-file\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-run-k8s-cni-cncf-io\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-os-release\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysconfig\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-hosts-file\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-os-release\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-lib-modules\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.894959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-netns\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-cni-binary-copy\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7thng\" (UniqueName: \"kubernetes.io/projected/d8889fd1-0618-408e-be2b-7ff880f12d43-kube-api-access-7thng\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cnibin\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/910d687d-8698-4e16-85f1-701b47bc2e11-serviceca\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc1fdc80-a99b-4741-81ac-8b9e047157a0-iptables-alerter-script\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-multus\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.896964 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.897699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-system-cni-dir\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.897699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-cnibin\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.897699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.897699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8889fd1-0618-408e-be2b-7ff880f12d43-cni-binary-copy\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.897699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.895850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8889fd1-0618-408e-be2b-7ff880f12d43-host-var-lib-cni-multus\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.899174 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.899153    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:03.899273 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.899179    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:03.899273 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.899190    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:03.899369 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.899287    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.399268419 +0000 UTC m=+3.003753304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:03.899468 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.899372    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:35:03.903110 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.903089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g829\" (UniqueName: \"kubernetes.io/projected/87ba6294-82a7-4dd0-8c8c-103e1c00f9a7-kube-api-access-8g829\") pod \"multus-additional-cni-plugins-262cq\" (UID: \"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7\") " pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:03.903212 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.903136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hlj\" (UniqueName: \"kubernetes.io/projected/2d998e2a-dacd-4e18-97f8-6a70986d3fbd-kube-api-access-69hlj\") pod \"node-resolver-w9k6z\" (UID: \"2d998e2a-dacd-4e18-97f8-6a70986d3fbd\") " pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:03.903212 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.903161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7thng\" (UniqueName: \"kubernetes.io/projected/d8889fd1-0618-408e-be2b-7ff880f12d43-kube-api-access-7thng\") pod \"multus-2lbbg\" (UID: \"d8889fd1-0618-408e-be2b-7ff880f12d43\") " pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:03.903212 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.903172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmgt7\" (UniqueName: \"kubernetes.io/projected/910d687d-8698-4e16-85f1-701b47bc2e11-kube-api-access-vmgt7\") pod \"node-ca-bxxvg\" (UID: \"910d687d-8698-4e16-85f1-701b47bc2e11\") " pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:03.983295 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.983248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal" event={"ID":"c2959093a1dac1f70892d700ea2e2faf","Type":"ContainerStarted","Data":"a389a5ba2b274c42ffdd02ed38982e2a9b1702961fe8eae8a3479be79529f2ff"}
Jul 27 20:35:03.984444 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.984420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal" event={"ID":"60cd812551eeb1408b6dd40f619589bc","Type":"ContainerStarted","Data":"cf3834e5d75aba2f0629ff33d7bf7ddd204947c6400b349726257a683e4f5e31"}
Jul 27 20:35:03.995864 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-sys-fs\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-conf\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-etc-tuned\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-systemd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfng\" (UniqueName: \"kubernetes.io/projected/fc1fdc80-a99b-4741-81ac-8b9e047157a0-kube-api-access-tgfng\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-sys-fs\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.995996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.995963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-systemd\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-run\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-host\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-systemd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4pp6\" (UniqueName: \"kubernetes.io/projected/e827a734-be1f-469c-82ce-999ffc77505a-kube-api-access-x4pp6\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-host\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-bin\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-systemd\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-kubelet-config\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-run\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-conf\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-bin\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-kubelet-config\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-ovn\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-socket-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-ovn\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.996370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-device-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.996333    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-device-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-kubelet\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-kubelet\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-socket-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.996457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.496436668 +0000 UTC m=+3.100921549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-var-lib-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-dbus\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-var-lib-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-modprobe-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-tmp\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3295c789-7119-4780-9f0f-2e658d8b3bef-dbus\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.997278 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-modprobe-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-netd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-run-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-script-lib\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-node-log\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-node-log\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-env-overrides\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-cni-netd\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-registration-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-registration-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-config\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovn-node-metrics-cert\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.996992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-slash\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-etc-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-var-lib-kubelet\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:03.998112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-systemd-units\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc1fdc80-a99b-4741-81ac-8b9e047157a0-host-slash\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysconfig\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-lib-modules\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-netns\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc1fdc80-a99b-4741-81ac-8b9e047157a0-iptables-alerter-script\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5cq\" (UniqueName: \"kubernetes.io/projected/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kube-api-access-4g5cq\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-env-overrides\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc1fdc80-a99b-4741-81ac-8b9e047157a0-host-slash\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-sys\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-script-lib\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54de0569-bde8-4abf-9e79-9add0750da49-konnectivity-ca\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovnkube-config\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-lib-modules\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:04.002798 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysconfig\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-etc-openvswitch\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-log-socket\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-systemd-units\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqrl\" (UniqueName: \"kubernetes.io/projected/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-kube-api-access-dvqrl\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.997621    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-sys\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.997629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54de0569-bde8-4abf-9e79-9add0750da49-agent-certs\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998146    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-var-lib-kubelet\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-sysctl-d\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54de0569-bde8-4abf-9e79-9add0750da49-konnectivity-ca\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:03.997672    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:04.497654289 +0000 UTC m=+3.102139162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6gf\" (UniqueName: \"kubernetes.io/projected/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-kube-api-access-4b6gf\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-kubernetes\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e827a734-be1f-469c-82ce-999ffc77505a-etc-kubernetes\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-log-socket\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.998993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-slash\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.003718 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.999088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-host-run-netns\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.004709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.999109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-etc-tuned\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.004709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.999199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e827a734-be1f-469c-82ce-999ffc77505a-tmp\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.004709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:03.999797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc1fdc80-a99b-4741-81ac-8b9e047157a0-iptables-alerter-script\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.004709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.000505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-ovn-node-metrics-cert\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.004709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.004096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54de0569-bde8-4abf-9e79-9add0750da49-agent-certs\") pod \"konnectivity-agent-mjwgc\" (UID: \"54de0569-bde8-4abf-9e79-9add0750da49\") " pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:04.005494 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.005471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfng\" (UniqueName: \"kubernetes.io/projected/fc1fdc80-a99b-4741-81ac-8b9e047157a0-kube-api-access-tgfng\") pod \"iptables-alerter-mmt6n\" (UID: \"fc1fdc80-a99b-4741-81ac-8b9e047157a0\") " pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.005862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.005845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4pp6\" (UniqueName: \"kubernetes.io/projected/e827a734-be1f-469c-82ce-999ffc77505a-kube-api-access-x4pp6\") pod \"tuned-4mj56\" (UID: \"e827a734-be1f-469c-82ce-999ffc77505a\") " pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.010198 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.010140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6gf\" (UniqueName: \"kubernetes.io/projected/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-kube-api-access-4b6gf\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:04.010310 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.010264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5cq\" (UniqueName: \"kubernetes.io/projected/a4cf1544-dd3d-4a56-ab78-ef73314fbee5-kube-api-access-4g5cq\") pod \"aws-ebs-csi-driver-node-lmgtn\" (UID: \"a4cf1544-dd3d-4a56-ab78-ef73314fbee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:04.010829 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.010802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqrl\" (UniqueName: \"kubernetes.io/projected/6fdf24a6-2171-4c9a-9e5b-cc08682028bb-kube-api-access-dvqrl\") pod \"ovnkube-node-ndw6k\" (UID: \"6fdf24a6-2171-4c9a-9e5b-cc08682028bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.083253 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.083187    2563 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:07fbd48ca456566beafdc728cc95e6ea1d7f665beaeb6be473ff6e78510c182b: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559"
Jul 27 20:35:04.083410 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.083383    2563 kuberuntime_manager.go:1459] "Unhandled Error" err="container haproxy start failed in pod kube-apiserver-proxy-ip-10-0-140-195.ec2.internal_kube-system(c2959093a1dac1f70892d700ea2e2faf): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:07fbd48ca456566beafdc728cc95e6ea1d7f665beaeb6be473ff6e78510c182b: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 27 20:35:04.083483 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.083428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:07fbd48ca456566beafdc728cc95e6ea1d7f665beaeb6be473ff6e78510c182b: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal" podUID="c2959093a1dac1f70892d700ea2e2faf"
Jul 27 20:35:04.086384 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.086356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lbbg"
Jul 27 20:35:04.095445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.095419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9k6z"
Jul 27 20:35:04.106507 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.106489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxxvg"
Jul 27 20:35:04.113270 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.113251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-262cq"
Jul 27 20:35:04.121069 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.121049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:04.130711 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.130689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mmt6n"
Jul 27 20:35:04.143539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.143518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn"
Jul 27 20:35:04.150347 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.150326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mj56"
Jul 27 20:35:04.157107 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.157083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:04.364127 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.364098    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdf24a6_2171_4c9a_9e5b_cc08682028bb.slice/crio-b8a8a9b6473491b0ff0a4bc182fadfb93cb285074341d2a66841d053eb654919 WatchSource:0}: Error finding container b8a8a9b6473491b0ff0a4bc182fadfb93cb285074341d2a66841d053eb654919: Status 404 returned error can't find the container with id b8a8a9b6473491b0ff0a4bc182fadfb93cb285074341d2a66841d053eb654919
Jul 27 20:35:04.366864 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.366836    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cf1544_dd3d_4a56_ab78_ef73314fbee5.slice/crio-17016eec366c8fc64f9ebbdbeb196f81ee2c2fa4910faecf8bdc67e5ccf68116 WatchSource:0}: Error finding container 17016eec366c8fc64f9ebbdbeb196f81ee2c2fa4910faecf8bdc67e5ccf68116: Status 404 returned error can't find the container with id 17016eec366c8fc64f9ebbdbeb196f81ee2c2fa4910faecf8bdc67e5ccf68116
Jul 27 20:35:04.368435 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.368410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d998e2a_dacd_4e18_97f8_6a70986d3fbd.slice/crio-464b4ab847b333d43ba10dc96272b4223b248e5e6d6bc5460c93fac7b3d94064 WatchSource:0}: Error finding container 464b4ab847b333d43ba10dc96272b4223b248e5e6d6bc5460c93fac7b3d94064: Status 404 returned error can't find the container with id 464b4ab847b333d43ba10dc96272b4223b248e5e6d6bc5460c93fac7b3d94064
Jul 27 20:35:04.369951 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.369883    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8889fd1_0618_408e_be2b_7ff880f12d43.slice/crio-2467b1edad4e85f6bf13dfab603f4c6d9064f029b85868947d48975b456953ad WatchSource:0}: Error finding container 2467b1edad4e85f6bf13dfab603f4c6d9064f029b85868947d48975b456953ad: Status 404 returned error can't find the container with id 2467b1edad4e85f6bf13dfab603f4c6d9064f029b85868947d48975b456953ad
Jul 27 20:35:04.370887 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.370860    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ba6294_82a7_4dd0_8c8c_103e1c00f9a7.slice/crio-9977de7d25b27d4afc7f1b85c1c4113991b28348d8eaf94c79736c67ad5a63c7 WatchSource:0}: Error finding container 9977de7d25b27d4afc7f1b85c1c4113991b28348d8eaf94c79736c67ad5a63c7: Status 404 returned error can't find the container with id 9977de7d25b27d4afc7f1b85c1c4113991b28348d8eaf94c79736c67ad5a63c7
Jul 27 20:35:04.373650 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.372148    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode827a734_be1f_469c_82ce_999ffc77505a.slice/crio-e1a5e1ad90b674df8dd20dcd54ae008f54b472c79c0d8211d2571faaa14413ea WatchSource:0}: Error finding container e1a5e1ad90b674df8dd20dcd54ae008f54b472c79c0d8211d2571faaa14413ea: Status 404 returned error can't find the container with id e1a5e1ad90b674df8dd20dcd54ae008f54b472c79c0d8211d2571faaa14413ea
Jul 27 20:35:04.373650 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.372752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910d687d_8698_4e16_85f1_701b47bc2e11.slice/crio-70bf0e84b3979053162886c843f67df42e6114e45e14a3611aa1be91b00f35d7 WatchSource:0}: Error finding container 70bf0e84b3979053162886c843f67df42e6114e45e14a3611aa1be91b00f35d7: Status 404 returned error can't find the container with id 70bf0e84b3979053162886c843f67df42e6114e45e14a3611aa1be91b00f35d7
Jul 27 20:35:04.374287 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.374265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1fdc80_a99b_4741_81ac_8b9e047157a0.slice/crio-4e73171ed31ecc166b76e5d638ab581514a4b0e425f3708fa56cef03c5a53821 WatchSource:0}: Error finding container 4e73171ed31ecc166b76e5d638ab581514a4b0e425f3708fa56cef03c5a53821: Status 404 returned error can't find the container with id 4e73171ed31ecc166b76e5d638ab581514a4b0e425f3708fa56cef03c5a53821
Jul 27 20:35:04.376650 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:04.375146    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54de0569_bde8_4abf_9e79_9add0750da49.slice/crio-a6b7124311cdb654b9bcd8be00f0cb32df25d8c9efd7a0398b8ed12b996a4603 WatchSource:0}: Error finding container a6b7124311cdb654b9bcd8be00f0cb32df25d8c9efd7a0398b8ed12b996a4603: Status 404 returned error can't find the container with id a6b7124311cdb654b9bcd8be00f0cb32df25d8c9efd7a0398b8ed12b996a4603
Jul 27 20:35:04.401672 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.401651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:04.401834 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.401815    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:04.401874 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.401847    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:04.401874 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.401861    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:04.401971 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.401949    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.401901252 +0000 UTC m=+4.006386127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:04.502800 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.502754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:04.502909 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.502842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:04.502909 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.502892    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:04.503007 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.502946    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:04.503007 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.502953    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.502937422 +0000 UTC m=+4.107422279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:04.503136 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:04.503018    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:05.502976426 +0000 UTC m=+4.107461283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:04.832055 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.831999    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:30:04 +0000 UTC" deadline="2028-03-14 05:16:12.721175549 +0000 UTC"
Jul 27 20:35:04.832055 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.832049    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14288h41m7.889130672s"
Jul 27 20:35:04.997667 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:04.997479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjwgc" event={"ID":"54de0569-bde8-4abf-9e79-9add0750da49","Type":"ContainerStarted","Data":"a6b7124311cdb654b9bcd8be00f0cb32df25d8c9efd7a0398b8ed12b996a4603"}
Jul 27 20:35:05.005407 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.005068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmt6n" event={"ID":"fc1fdc80-a99b-4741-81ac-8b9e047157a0","Type":"ContainerStarted","Data":"4e73171ed31ecc166b76e5d638ab581514a4b0e425f3708fa56cef03c5a53821"}
Jul 27 20:35:05.008628 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.008598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9k6z" event={"ID":"2d998e2a-dacd-4e18-97f8-6a70986d3fbd","Type":"ContainerStarted","Data":"464b4ab847b333d43ba10dc96272b4223b248e5e6d6bc5460c93fac7b3d94064"}
Jul 27 20:35:05.012193 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.011925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbbg" event={"ID":"d8889fd1-0618-408e-be2b-7ff880f12d43","Type":"ContainerStarted","Data":"2467b1edad4e85f6bf13dfab603f4c6d9064f029b85868947d48975b456953ad"}
Jul 27 20:35:05.018329 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.018300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn" event={"ID":"a4cf1544-dd3d-4a56-ab78-ef73314fbee5","Type":"ContainerStarted","Data":"17016eec366c8fc64f9ebbdbeb196f81ee2c2fa4910faecf8bdc67e5ccf68116"}
Jul 27 20:35:05.022866 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.022838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"b8a8a9b6473491b0ff0a4bc182fadfb93cb285074341d2a66841d053eb654919"}
Jul 27 20:35:05.029268 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.029240    2563 generic.go:356] "Generic (PLEG): container finished" podID="60cd812551eeb1408b6dd40f619589bc" containerID="58d0730baa4699d404ccb6c122895b4449e83860398b7e9c1afd2e88d5091d70" exitCode=0
Jul 27 20:35:05.029365 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.029319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal" event={"ID":"60cd812551eeb1408b6dd40f619589bc","Type":"ContainerDied","Data":"58d0730baa4699d404ccb6c122895b4449e83860398b7e9c1afd2e88d5091d70"}
Jul 27 20:35:05.045388 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.045361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxxvg" event={"ID":"910d687d-8698-4e16-85f1-701b47bc2e11","Type":"ContainerStarted","Data":"70bf0e84b3979053162886c843f67df42e6114e45e14a3611aa1be91b00f35d7"}
Jul 27 20:35:05.067923 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.067856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mj56" event={"ID":"e827a734-be1f-469c-82ce-999ffc77505a","Type":"ContainerStarted","Data":"e1a5e1ad90b674df8dd20dcd54ae008f54b472c79c0d8211d2571faaa14413ea"}
Jul 27 20:35:05.080059 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.080019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerStarted","Data":"9977de7d25b27d4afc7f1b85c1c4113991b28348d8eaf94c79736c67ad5a63c7"}
Jul 27 20:35:05.081707 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.081672    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:07fbd48ca456566beafdc728cc95e6ea1d7f665beaeb6be473ff6e78510c182b: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal" podUID="c2959093a1dac1f70892d700ea2e2faf"
Jul 27 20:35:05.084335 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.084311    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:35:05.417961 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.417887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:05.418208 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.418105    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:05.418208 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.418130    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:05.418208 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.418145    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:05.418421 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.418211    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.418191086 +0000 UTC m=+6.022675948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:05.519263 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.519189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:05.519263 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.519254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:05.519453 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.519396    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:05.519513 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.519460    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.519439744 +0000 UTC m=+6.123924618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:05.519870 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.519850    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:05.519944 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.519909    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:07.519894116 +0000 UTC m=+6.124378989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:05.833080 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.832885    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:30:04 +0000 UTC" deadline="2028-01-08 09:36:04.857348886 +0000 UTC"
Jul 27 20:35:05.833080 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.832951    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12709h0m59.024402676s"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.979924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.980066    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.980461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.980570    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:05.980634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:05.980803 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:05.980706    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:06.089325 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:06.089214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal" event={"ID":"60cd812551eeb1408b6dd40f619589bc","Type":"ContainerStarted","Data":"5b7b85f6a4596e52b2a5c737ab78099a7f8e375060f79e086a6900cff1a045d5"}
Jul 27 20:35:07.435606 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.435568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:07.436107 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.435733    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:07.436107 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.435762    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:07.436107 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.435776    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:07.436107 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.435840    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.435820025 +0000 UTC m=+10.040304887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.536815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.536889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.537053    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.537110    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.537093844 +0000 UTC m=+10.141578699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.537542    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:07.537636 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.537600    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:11.537584118 +0000 UTC m=+10.142068979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:07.978843 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.978150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:07.978843 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.978277    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:07.978843 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.978675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:07.978843 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.978791    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:07.979424 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:07.979278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:07.979424 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:07.979391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:09.977112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:09.977074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:09.977565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:09.977132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:09.977565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:09.977211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:09.977565 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:09.977315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:09.977729 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:09.977641    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:09.977786 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:09.977734    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:11.469061 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.469027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:11.469531 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.469216    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:11.469531 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.469242    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:11.469531 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.469257    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:11.469531 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.469321    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.469301827 +0000 UTC m=+18.073786694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:11.569849 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.569814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:11.570232 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.569883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:11.570232 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.570030    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:11.570232 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.570038    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:11.570232 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.570095    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.570075191 +0000 UTC m=+18.174560048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:11.570232 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.570116    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:19.570106094 +0000 UTC m=+18.174590970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.977738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.977839    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.978215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.978307    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:11.978350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:11.978459 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:11.978426    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:13.977005 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:13.976923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:13.977467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:13.976948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:13.977467 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:13.977118    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:13.977467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:13.977194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:13.977467 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:13.977321    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:13.977467 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:13.977413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:15.976888 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:15.976847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:15.977360 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:15.976847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:15.977360 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:15.976864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:15.977360 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:15.976982    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:15.977360 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:15.977055    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:15.977360 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:15.977187    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:17.976987 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:17.976925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:17.977429 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:17.976997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:17.977429 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:17.976925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:17.977429 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:17.977358    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:17.977553 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:17.977491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:17.978125 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:17.977687    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:17.990042 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:17.989988    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-195.ec2.internal" podStartSLOduration=14.989957856 podStartE2EDuration="14.989957856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:06.10865072 +0000 UTC m=+4.713135601" watchObservedRunningTime="2026-07-27 20:35:17.989957856 +0000 UTC m=+16.594442733"
Jul 27 20:35:19.531753 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.531703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:19.532219 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.531899    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:19.532219 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.531922    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:19.532219 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.531937    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:19.532219 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.532017    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.531995707 +0000 UTC m=+34.136480572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:19.632838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.632801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:19.633033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.632855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:19.633033 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.632985    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:19.633127 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.633059    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.633039479 +0000 UTC m=+34.237524347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:19.633127 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.632993    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:19.633205 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.633156    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:35:35.63313851 +0000 UTC m=+34.237623364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:19.976816 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.976732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:19.976816 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.976786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:19.977060 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:19.976809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:19.977060 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.976894    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:19.977060 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.977018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:19.977218 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:19.977120    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:21.978238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:21.978146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:21.978920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:21.978806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:21.978920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:21.978850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:21.979104 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:21.978811    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:21.979104 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:21.978949    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:21.979104 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:21.979035    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:23.977740 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:23.977435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:23.978486 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:23.977849    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:23.978486 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:23.977482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:23.978486 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:23.977944    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:23.978486 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:23.977441    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:23.978486 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:23.978033    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:24.129893 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.129852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjwgc" event={"ID":"54de0569-bde8-4abf-9e79-9add0750da49","Type":"ContainerStarted","Data":"74cb4823d2c883a527572500c29db8b7a3b7da81ecdf35cb98a941a13e675948"}
Jul 27 20:35:24.131484 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.131454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9k6z" event={"ID":"2d998e2a-dacd-4e18-97f8-6a70986d3fbd","Type":"ContainerStarted","Data":"6cdd8bf1ccdaa1b8dbf0e83a4188517f4f3b84050fa4378eaea837a3c13c5d1a"}
Jul 27 20:35:24.133256 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.133153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lbbg" event={"ID":"d8889fd1-0618-408e-be2b-7ff880f12d43","Type":"ContainerStarted","Data":"66bbce35d8738abe51ee32f043afa7e1c3f382b1c15f8e3a54ac07cbe93ea11d"}
Jul 27 20:35:24.134763 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.134737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn" event={"ID":"a4cf1544-dd3d-4a56-ab78-ef73314fbee5","Type":"ContainerStarted","Data":"74148845d4ffde9b723bc1f7e1e4ab70bd2b63368056a68e986a6be0c684fc75"}
Jul 27 20:35:24.136361 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.136332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"15490bd8f60bcb3c3cec1760265acd2aa616d0716dbc88527bab6c3717701abb"}
Jul 27 20:35:24.137991 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.137942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxxvg" event={"ID":"910d687d-8698-4e16-85f1-701b47bc2e11","Type":"ContainerStarted","Data":"08c7aa968a53b3be1123f3b0be385bd7200a0d391e98cd3c280b6ca2b198c07d"}
Jul 27 20:35:24.139408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.139389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mj56" event={"ID":"e827a734-be1f-469c-82ce-999ffc77505a","Type":"ContainerStarted","Data":"5b95c98dbc801fbc8282ec077a52c3b599d5489169f00ff562a3f50b73ce6cc5"}
Jul 27 20:35:24.140812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.140792    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="375d823f318ce780505ba9b4d3a9668e01fc262e7f5f96727d8513b43d647838" exitCode=0
Jul 27 20:35:24.140906 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.140824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"375d823f318ce780505ba9b4d3a9668e01fc262e7f5f96727d8513b43d647838"}
Jul 27 20:35:24.143306 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.143262    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mjwgc" podStartSLOduration=11.486460059 podStartE2EDuration="22.143246097s" totalImagesPullingTime="10.656786038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:24.142936546 +0000 UTC m=+22.747421422" watchObservedRunningTime="2026-07-27 20:35:24.143246097 +0000 UTC m=+22.747730972"
Jul 27 20:35:24.156904 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.156869    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4mj56" podStartSLOduration=3.367540312 podStartE2EDuration="22.156854464s" totalImagesPullingTime="18.789314152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:24.156492976 +0000 UTC m=+22.760977850" watchObservedRunningTime="2026-07-27 20:35:24.156854464 +0000 UTC m=+22.761339339"
Jul 27 20:35:24.169377 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.169338    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w9k6z" podStartSLOduration=3.400072826 podStartE2EDuration="22.169326745s" totalImagesPullingTime="18.769253919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:24.169117098 +0000 UTC m=+22.773601974" watchObservedRunningTime="2026-07-27 20:35:24.169326745 +0000 UTC m=+22.773811616"
Jul 27 20:35:24.181056 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.181019    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxxvg" podStartSLOduration=3.439336922 podStartE2EDuration="22.18100735s" totalImagesPullingTime="18.741670428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:24.180804946 +0000 UTC m=+22.785289820" watchObservedRunningTime="2026-07-27 20:35:24.18100735 +0000 UTC m=+22.785492225"
Jul 27 20:35:24.195027 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.194994    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2lbbg" podStartSLOduration=3.4041097750000002 podStartE2EDuration="22.194983175s" totalImagesPullingTime="18.7908734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:24.194747798 +0000 UTC m=+22.799232673" watchObservedRunningTime="2026-07-27 20:35:24.194983175 +0000 UTC m=+22.799468043"
Jul 27 20:35:24.724231 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:24.724207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:25.117792 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.117756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:25.144231 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.144197    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal" event={"ID":"c2959093a1dac1f70892d700ea2e2faf","Type":"ContainerStarted","Data":"e559e1d8cb87f55a7fca65ed98dbf5da847104d1e25170cf275a7b1d72b4d54a"}
Jul 27 20:35:25.145955 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.145931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mmt6n" event={"ID":"fc1fdc80-a99b-4741-81ac-8b9e047157a0","Type":"ContainerStarted","Data":"4730a90638938928f69f9d54c9206a1c321aeb98f7564b0c1b049f71678b7611"}
Jul 27 20:35:25.148893 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.148854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"d9fc427ad612877186fef1e7fbed911413c6b8e635a4ca9499facab2f93018b5"}
Jul 27 20:35:25.149014 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.148930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"6aa0b6bdfa5147511b5022b8dc86881c7e8d3e831e49b940c81f794d01739eb4"}
Jul 27 20:35:25.149014 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.148976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"ce9915540cc225c242335d37824d1b1eccc76010220626cb2e6bb805997fbf9c"}
Jul 27 20:35:25.162143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.162100    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-195.ec2.internal" podStartSLOduration=22.16208393 podStartE2EDuration="22.16208393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:25.162014501 +0000 UTC m=+23.766499377" watchObservedRunningTime="2026-07-27 20:35:25.16208393 +0000 UTC m=+23.766568806"
Jul 27 20:35:25.174180 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.174135    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mmt6n" podStartSLOduration=4.43241044 podStartE2EDuration="23.1741184s" totalImagesPullingTime="18.74170796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:25.173823138 +0000 UTC m=+23.778308014" watchObservedRunningTime="2026-07-27 20:35:25.1741184 +0000 UTC m=+23.778603276"
Jul 27 20:35:25.278269 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.278242    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:35:25.317215 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.317187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:25.517835 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.517762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:25.853135 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.852915    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:35:25.278267705Z","UUID":"94096e94-1473-4036-8d54-7d82bf17db51","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:35:25.854736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.854712    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:35:25.854873 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.854755    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:35:25.980672 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.980646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:25.980866 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:25.980827    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:25.981091 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.981069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:25.981212 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:25.981104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:25.981269 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:25.981212    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:25.981326 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:25.981303    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:26.104725 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.104638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:26.153461 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.153423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn" event={"ID":"a4cf1544-dd3d-4a56-ab78-ef73314fbee5","Type":"ContainerStarted","Data":"945ff0e07bc844e556ca165bc41c30f10d0090f4d5a8cb9c3a5f24c78d8044f5"}
Jul 27 20:35:26.157183 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.157158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"07a9c4ecc91ac0880360d5ccd19fca5b220fc8592dab6ea8cbaa0a89fa29ae80"}
Jul 27 20:35:26.157306 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.157233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"38f3b165e0f2b279a9e31d8bbd2fb9acdcf5503f0d1e79222924cbc728794ae9"}
Jul 27 20:35:26.277716 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.277687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:26.482837 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.482813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:26.483346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:26.483326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:27.022107 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.021916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:27.022553 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.022532    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mjwgc"
Jul 27 20:35:27.162511 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.162454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn" event={"ID":"a4cf1544-dd3d-4a56-ab78-ef73314fbee5","Type":"ContainerStarted","Data":"96646cda6dbf3f90849da2f94ef5a4b4f7a9091056b399caf22bcd042ff0f989"}
Jul 27 20:35:27.179395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.179348    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmgtn" podStartSLOduration=3.580796618 podStartE2EDuration="25.179334311s" totalImagesPullingTime="21.598537693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:27.179307135 +0000 UTC m=+25.783792011" watchObservedRunningTime="2026-07-27 20:35:27.179334311 +0000 UTC m=+25.783819186"
Jul 27 20:35:27.980210 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.980183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:27.980210 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.980204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:27.980424 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:27.980205    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:27.980424 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:27.980285    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:27.980424 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:27.980397    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:27.980547 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:27.980499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:29.168156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.168072    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="54264b85019a3a5d57f71db4a73dd790b6cafe475adc1bc06d42c3db671dfbe3" exitCode=0
Jul 27 20:35:29.168156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.168147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"54264b85019a3a5d57f71db4a73dd790b6cafe475adc1bc06d42c3db671dfbe3"}
Jul 27 20:35:29.171482 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.171462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"bf0cf5f6089745b5e3980239ae606328349d0e28dc6815600be2008c604339b0"}
Jul 27 20:35:29.977134 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.977058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:29.977134 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.977066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:29.977413 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:29.977194    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:29.977413 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:29.977230    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:29.977413 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:29.977279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:29.977413 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:29.977377    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:31.179841 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.179620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" event={"ID":"6fdf24a6-2171-4c9a-9e5b-cc08682028bb","Type":"ContainerStarted","Data":"3084ca7dce538624576deb1fdcd9ba56b7aafe25bd2c4c2ee49842c29993945c"}
Jul 27 20:35:31.180483 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.179916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:31.181928 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.181898    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="e32f76d8885290b8eaf2655716c1530ce154431f0cde893f9c57f3cfdabe8bf6" exitCode=0
Jul 27 20:35:31.182078 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.181940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"e32f76d8885290b8eaf2655716c1530ce154431f0cde893f9c57f3cfdabe8bf6"}
Jul 27 20:35:31.196042 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.196021    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:31.279453 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.279417    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k" podStartSLOduration=10.062142287 podStartE2EDuration="29.279403251s" totalImagesPullingTime="19.217260964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:31.22855796 +0000 UTC m=+29.833042835" watchObservedRunningTime="2026-07-27 20:35:31.279403251 +0000 UTC m=+29.883888126"
Jul 27 20:35:31.980370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.980344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:31.980538 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:31.980428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:31.980538 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.980344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:31.980538 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:31.980495    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:31.980538 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:31.980344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:31.980729 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:31.980582    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:32.183811 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.183782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:32.184187 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.183857    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:32.190875 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.190849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:32.198625 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.198605    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:35:32.289321 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.289299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:32.386066 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.386040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:32.486030 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.485948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:32.543445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:32.543420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:33.188485 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.188455    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="2e3e6898faf214bbb98c2d43adb0c3f4b349f77017a8a3a9e73f92830f2376c5" exitCode=0
Jul 27 20:35:33.188862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.188538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"2e3e6898faf214bbb98c2d43adb0c3f4b349f77017a8a3a9e73f92830f2376c5"}
Jul 27 20:35:33.854449 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.854208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpmx8"]
Jul 27 20:35:33.854590 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.854482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:33.854656 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:33.854581    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:33.862050 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.861928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjv5r"]
Jul 27 20:35:33.862192 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.862060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:33.862192 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:33.862163    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:33.862733 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.862712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrhdg"]
Jul 27 20:35:33.862838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:33.862792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:33.862974 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:33.862944    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:35.456758 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.456727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:35.554190 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.554157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:35.554372 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.554305    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:35:35.554372 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.554327    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:35:35.554372 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.554339    2563 projected.go:196] Error preparing data for projected volume kube-api-access-tc7r6 for pod openshift-network-diagnostics/network-check-target-fpmx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:35.554523 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.554398    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6 podName:55a7cf9a-1257-4c44-9ed0-798c84413564 nodeName:}" failed. No retries permitted until 2026-07-27 20:36:07.554380373 +0000 UTC m=+66.158865439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tc7r6" (UniqueName: "kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6") pod "network-check-target-fpmx8" (UID: "55a7cf9a-1257-4c44-9ed0-798c84413564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:35:35.558421 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.558392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:35.655366 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.655338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:35.655542 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.655376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:35.655542 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.655486    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:35.655648 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.655547    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret podName:3295c789-7119-4780-9f0f-2e658d8b3bef nodeName:}" failed. No retries permitted until 2026-07-27 20:36:07.655530446 +0000 UTC m=+66.260015299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret") pod "global-pull-secret-syncer-hrhdg" (UID: "3295c789-7119-4780-9f0f-2e658d8b3bef") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:35:35.655648 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.655489    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:35.655648 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.655628    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs podName:ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0 nodeName:}" failed. No retries permitted until 2026-07-27 20:36:07.655615641 +0000 UTC m=+66.260100501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs") pod "network-metrics-daemon-wjv5r" (UID: "ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:35:35.735703 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.735651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:35.976922 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.976892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:35.977115 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.976940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:35.977115 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:35.976892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:35.977115 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.977031    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpmx8" podUID="55a7cf9a-1257-4c44-9ed0-798c84413564"
Jul 27 20:35:35.977281 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.977165    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrhdg" podUID="3295c789-7119-4780-9f0f-2e658d8b3bef"
Jul 27 20:35:35.977281 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:35:35.977268    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjv5r" podUID="ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0"
Jul 27 20:35:36.122478 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:36.122395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.186298 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:36.186262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:36.309057 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:36.309022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:37.164021 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.163944    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-195.ec2.internal" event="NodeReady"
Jul 27 20:35:37.164534 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.164109    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:35:37.198466 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.198444    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-769b64b76-5kxjb"]
Jul 27 20:35:37.202509 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.201438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.203916 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.203891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:35:37.203916 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.203911    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:35:37.204243 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.204229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8k9nx\""
Jul 27 20:35:37.204318 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.204264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:35:37.212285 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.212243    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7mhr2"]
Jul 27 20:35:37.214827 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.214810    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:35:37.216217 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.216192    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-58gx2"]
Jul 27 20:35:37.216332 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.216315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.218411 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.218392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgqwx\""
Jul 27 20:35:37.218527 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.218470    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:35:37.218673 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.218655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:35:37.218953 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.218939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769b64b76-5kxjb"]
Jul 27 20:35:37.219056 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.219022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.221300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.221105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:35:37.221300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.221145    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:35:37.221300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.221157    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:35:37.221300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.221154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8t4xf\""
Jul 27 20:35:37.221544 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.221488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:35:37.223211 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.223140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7mhr2"]
Jul 27 20:35:37.229139 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.229123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-58gx2"]
Jul 27 20:35:37.309937 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.309914    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w62fv"]
Jul 27 20:35:37.318269 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.318251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.320772 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.320743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:35:37.320879 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.320781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:35:37.320879 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.320827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mlcnn\""
Jul 27 20:35:37.321108 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.321068    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:35:37.321159 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.321114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w62fv"]
Jul 27 20:35:37.330082 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.330051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:37.365570 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-certificates\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365570 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-bound-sa-token\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-trusted-ca\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.365786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9k9\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-kube-api-access-7j9k9\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l84ll\" (UniqueName: \"kubernetes.io/projected/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-api-access-l84ll\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.365948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-image-registry-private-configuration\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-installation-pull-secrets\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-tls\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-ca-trust-extracted\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.365948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.365931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.366214 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-config-volume\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.366214 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-metrics-tls\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.366214 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-tmp-dir\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.366214 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-crio-socket\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.366214 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jblcn\" (UniqueName: \"kubernetes.io/projected/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-kube-api-access-jblcn\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.366467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.366234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-data-volume\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.384660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.384617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:37.466736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-config-volume\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.466818 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-metrics-tls\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.466818 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-tmp-dir\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.466818 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-crio-socket\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.466818 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbrcp\" (UniqueName: \"kubernetes.io/projected/18c12568-02b9-402e-8a23-f041165c1c41-kube-api-access-qbrcp\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jblcn\" (UniqueName: \"kubernetes.io/projected/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-kube-api-access-jblcn\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-data-volume\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-certificates\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-bound-sa-token\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-trusted-ca\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.466998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9k9\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-kube-api-access-7j9k9\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l84ll\" (UniqueName: \"kubernetes.io/projected/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-api-access-l84ll\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c12568-02b9-402e-8a23-f041165c1c41-cert\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-crio-socket\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-image-registry-private-configuration\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-installation-pull-secrets\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-tls\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-tmp-dir\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-ca-trust-extracted\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467737 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-config-volume\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.467737 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-ca-trust-extracted\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.467737 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-data-volume\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.467911 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.467831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.468279 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.468117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-certificates\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.468437 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.468418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-trusted-ca\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.470874 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.470850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.471033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.471017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-metrics-tls\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.471135 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.471118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-installation-pull-secrets\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.471174 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.471118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-image-registry-private-configuration\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.471174 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.471159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-registry-tls\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.474389 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.474372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jblcn\" (UniqueName: \"kubernetes.io/projected/0ddd3487-b7f4-4895-9be4-54cd1a8a984e-kube-api-access-jblcn\") pod \"dns-default-7mhr2\" (UID: \"0ddd3487-b7f4-4895-9be4-54cd1a8a984e\") " pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.474662 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.474641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-bound-sa-token\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.474839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.474824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9k9\" (UniqueName: \"kubernetes.io/projected/213105bd-d07d-479a-b16b-3c0fa5fa0cbe-kube-api-access-7j9k9\") pod \"image-registry-769b64b76-5kxjb\" (UID: \"213105bd-d07d-479a-b16b-3c0fa5fa0cbe\") " pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.475018 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.475003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l84ll\" (UniqueName: \"kubernetes.io/projected/e1dc6c03-f62e-4c15-9d05-fa4b5218a63f-kube-api-access-l84ll\") pod \"insights-runtime-extractor-58gx2\" (UID: \"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f\") " pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.512234 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.512206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:37.524701 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.524673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:37.526571 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.526557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:37.532305 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.532290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-58gx2"
Jul 27 20:35:37.567714 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.567686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c12568-02b9-402e-8a23-f041165c1c41-cert\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.567829 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.567798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbrcp\" (UniqueName: \"kubernetes.io/projected/18c12568-02b9-402e-8a23-f041165c1c41-kube-api-access-qbrcp\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.570142 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.570121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c12568-02b9-402e-8a23-f041165c1c41-cert\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.576512 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.576463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbrcp\" (UniqueName: \"kubernetes.io/projected/18c12568-02b9-402e-8a23-f041165c1c41-kube-api-access-qbrcp\") pod \"ingress-canary-w62fv\" (UID: \"18c12568-02b9-402e-8a23-f041165c1c41\") " pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.640185 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.640053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w62fv"
Jul 27 20:35:37.711591 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.711511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7mhr2"]
Jul 27 20:35:37.715478 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:37.715453    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddd3487_b7f4_4895_9be4_54cd1a8a984e.slice/crio-75e1a5316db54a570005f57f629e930d765ba658be278ce8859081c6adcb454c WatchSource:0}: Error finding container 75e1a5316db54a570005f57f629e930d765ba658be278ce8859081c6adcb454c: Status 404 returned error can't find the container with id 75e1a5316db54a570005f57f629e930d765ba658be278ce8859081c6adcb454c
Jul 27 20:35:37.729384 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.729348    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769b64b76-5kxjb"]
Jul 27 20:35:37.749339 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.749312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-58gx2"]
Jul 27 20:35:37.752238 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:37.752213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dc6c03_f62e_4c15_9d05_fa4b5218a63f.slice/crio-a5f2e466dd95dfd46796f7fc8cbb87c8bf3c216cf33a2b5578cc6cf75ee14c3f WatchSource:0}: Error finding container a5f2e466dd95dfd46796f7fc8cbb87c8bf3c216cf33a2b5578cc6cf75ee14c3f: Status 404 returned error can't find the container with id a5f2e466dd95dfd46796f7fc8cbb87c8bf3c216cf33a2b5578cc6cf75ee14c3f
Jul 27 20:35:37.800614 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.800471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w62fv"]
Jul 27 20:35:37.805518 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:37.805492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c12568_02b9_402e_8a23_f041165c1c41.slice/crio-f68692d6f62b119385e005ca62c33e8cbd339ecddb80b9bae0e814c67fd77b4b WatchSource:0}: Error finding container f68692d6f62b119385e005ca62c33e8cbd339ecddb80b9bae0e814c67fd77b4b: Status 404 returned error can't find the container with id f68692d6f62b119385e005ca62c33e8cbd339ecddb80b9bae0e814c67fd77b4b
Jul 27 20:35:37.886435 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.886409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:37.977523 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.977463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:35:37.977523 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.977481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:35:37.977687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.977664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:35:37.980087 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980065    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:35:37.980209 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:35:37.980298 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\""
Jul 27 20:35:37.980369 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:35:37.980429 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\""
Jul 27 20:35:37.980627 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.980612    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:35:37.990288 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:37.990179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:38.202784 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.202749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769b64b76-5kxjb" event={"ID":"213105bd-d07d-479a-b16b-3c0fa5fa0cbe","Type":"ContainerStarted","Data":"c270a1c5f6ab9acd79b6145dea6e1bde4429879f18d6c5e39ea849a2bd33119c"}
Jul 27 20:35:38.203350 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.202810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769b64b76-5kxjb" event={"ID":"213105bd-d07d-479a-b16b-3c0fa5fa0cbe","Type":"ContainerStarted","Data":"4aa2a81c839fb8e99f306f9751b7ae6c1c30c2cf19ab759f7d1b8c769a2bcc88"}
Jul 27 20:35:38.203350 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.202873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:38.204002 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.203980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w62fv" event={"ID":"18c12568-02b9-402e-8a23-f041165c1c41","Type":"ContainerStarted","Data":"f68692d6f62b119385e005ca62c33e8cbd339ecddb80b9bae0e814c67fd77b4b"}
Jul 27 20:35:38.205113 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.205080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7mhr2" event={"ID":"0ddd3487-b7f4-4895-9be4-54cd1a8a984e","Type":"ContainerStarted","Data":"75e1a5316db54a570005f57f629e930d765ba658be278ce8859081c6adcb454c"}
Jul 27 20:35:38.208071 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.208045    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="c466848ab2c44712abc8a7e67badfb734cc8e0d67a9ea5487538afd382da444b" exitCode=0
Jul 27 20:35:38.208170 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.208067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"c466848ab2c44712abc8a7e67badfb734cc8e0d67a9ea5487538afd382da444b"}
Jul 27 20:35:38.209251 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.209235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-58gx2" event={"ID":"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f","Type":"ContainerStarted","Data":"a5f2e466dd95dfd46796f7fc8cbb87c8bf3c216cf33a2b5578cc6cf75ee14c3f"}
Jul 27 20:35:38.220638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:38.220459    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-769b64b76-5kxjb" podStartSLOduration=6.220442676 podStartE2EDuration="6.220442676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:38.220042829 +0000 UTC m=+36.824527705" watchObservedRunningTime="2026-07-27 20:35:38.220442676 +0000 UTC m=+36.824927554"
Jul 27 20:35:39.217248 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:39.217001    2563 generic.go:356] "Generic (PLEG): container finished" podID="87ba6294-82a7-4dd0-8c8c-103e1c00f9a7" containerID="35fe3e76b684fde2772387a1650f37e007aec60de395f16e0a4e8458002a1696" exitCode=0
Jul 27 20:35:39.218326 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:39.217771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerDied","Data":"35fe3e76b684fde2772387a1650f37e007aec60de395f16e0a4e8458002a1696"}
Jul 27 20:35:40.224685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:40.224648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-262cq" event={"ID":"87ba6294-82a7-4dd0-8c8c-103e1c00f9a7","Type":"ContainerStarted","Data":"71a602b4259a5f8d96540f2532966930da6e8d43b83136ea4ad3d585c7b0957c"}
Jul 27 20:35:40.247238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:40.247148    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-262cq" podStartSLOduration=8.972599731 podStartE2EDuration="38.247124675s" totalImagesPullingTime="29.274524944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:40.245397299 +0000 UTC m=+38.849882166" watchObservedRunningTime="2026-07-27 20:35:40.247124675 +0000 UTC m=+38.851609551"
Jul 27 20:35:40.366761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:40.366725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:40.466634 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:40.466557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:40.521213 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:40.521121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.120378 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.120335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.177620 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.177589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.331594 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.331556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.432310 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.432278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.860127 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.860053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:41.936801 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:41.936769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:43.331698 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:43.331663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:43.382033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:43.382004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:44.066179 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:44.066123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:44.118487 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:44.118458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:44.173248 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:44.173210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:44.886663 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:44.886637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:44.990941 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:44.990914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:45.238140 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.238105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w62fv" event={"ID":"18c12568-02b9-402e-8a23-f041165c1c41","Type":"ContainerStarted","Data":"e1080e2472f312f07a5757f618fc889dc4e3f806561724b47cb94f9085b7a6e0"}
Jul 27 20:35:45.239821 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.239796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7mhr2" event={"ID":"0ddd3487-b7f4-4895-9be4-54cd1a8a984e","Type":"ContainerStarted","Data":"90eb78a8b97b62b7c4061ceb7860e7501aa933db316d98c064bac1ae6c390722"}
Jul 27 20:35:45.239926 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.239850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:45.239926 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.239877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7mhr2" event={"ID":"0ddd3487-b7f4-4895-9be4-54cd1a8a984e","Type":"ContainerStarted","Data":"6dacb35df317a4a651d10bd216b416255e561b3125a9c049cb41fcc63c568324"}
Jul 27 20:35:45.241267 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.241245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-58gx2" event={"ID":"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f","Type":"ContainerStarted","Data":"91a998f2b6b63cb8bd0a71c678fa72884fc12031ff4286dbacb512c3df2fb248"}
Jul 27 20:35:45.253158 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.253119    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w62fv" podStartSLOduration=1.5639037770000002 podStartE2EDuration="8.253107252s" totalImagesPullingTime="6.689203475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:45.252254252 +0000 UTC m=+43.856739131" watchObservedRunningTime="2026-07-27 20:35:45.253107252 +0000 UTC m=+43.857592124"
Jul 27 20:35:45.268111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:45.268042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7mhr2" podStartSLOduration=1.488471759 podStartE2EDuration="8.268025076s" totalImagesPullingTime="6.779553317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:45.267333274 +0000 UTC m=+43.871818149" watchObservedRunningTime="2026-07-27 20:35:45.268025076 +0000 UTC m=+43.872509952"
Jul 27 20:35:46.451940 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:46.451861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:46.556791 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:46.556752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:46.901251 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:46.901174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:47.006498 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.006465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:47.120015 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.119928    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"]
Jul 27 20:35:47.121727 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.121679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:47.195702 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.195672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"]
Jul 27 20:35:47.195825 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.195780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:47.198217 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.198193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 20:35:47.198340 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.198198    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zdjss\""
Jul 27 20:35:47.352381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.352344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25422b9d-0239-4343-a67e-5e87092553f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gpqbf\" (UID: \"25422b9d-0239-4343-a67e-5e87092553f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:47.453067 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.452983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25422b9d-0239-4343-a67e-5e87092553f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gpqbf\" (UID: \"25422b9d-0239-4343-a67e-5e87092553f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:47.457785 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.457757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25422b9d-0239-4343-a67e-5e87092553f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gpqbf\" (UID: \"25422b9d-0239-4343-a67e-5e87092553f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:47.500680 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.500646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:47.506592 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.506571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:47.733626 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.733538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:47.788148 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:47.788120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:48.479622 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:48.479587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:48.581978 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:48.581930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:49.384247 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:49.384220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"]
Jul 27 20:35:49.387146 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:35:49.387120    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25422b9d_0239_4343_a67e_5e87092553f8.slice/crio-b3b1d6911f5de3926b2966c71dbde84407713c8614f9725feb16d92bf4a284f4 WatchSource:0}: Error finding container b3b1d6911f5de3926b2966c71dbde84407713c8614f9725feb16d92bf4a284f4: Status 404 returned error can't find the container with id b3b1d6911f5de3926b2966c71dbde84407713c8614f9725feb16d92bf4a284f4
Jul 27 20:35:50.256725 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:50.256688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-58gx2" event={"ID":"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f","Type":"ContainerStarted","Data":"1eb889b3b1efc56bf1dfb5e88b34dbb20b1376a571a9402a0cb158f6e5f8d1d4"}
Jul 27 20:35:50.257954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:50.257926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf" event={"ID":"25422b9d-0239-4343-a67e-5e87092553f8","Type":"ContainerStarted","Data":"b3b1d6911f5de3926b2966c71dbde84407713c8614f9725feb16d92bf4a284f4"}
Jul 27 20:35:50.447933 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:50.447880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:50.529823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:50.529745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:50.626802 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:50.626753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:51.133064 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.132900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:51.233387 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.233353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:51.263366 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.263333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf" event={"ID":"25422b9d-0239-4343-a67e-5e87092553f8","Type":"ContainerStarted","Data":"8a9215eefda46b28e82390b845c391ae620b74a8024dca1924882034f056ae3b"}
Jul 27 20:35:51.263766 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.263501    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:51.269146 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.269124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf"
Jul 27 20:35:51.279612 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:51.279573    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gpqbf" podStartSLOduration=2.816315575 podStartE2EDuration="4.279561223s" totalImagesPullingTime="1.463245648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:51.278375661 +0000 UTC m=+49.882860536" watchObservedRunningTime="2026-07-27 20:35:51.279561223 +0000 UTC m=+49.884046077"
Jul 27 20:35:52.138998 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:52.138928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:52.240312 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:52.240279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:52.593788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:52.593754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:54.002148 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:54.002120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:54.051692 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:54.051659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:54.278642 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:54.278560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-58gx2" event={"ID":"e1dc6c03-f62e-4c15-9d05-fa4b5218a63f","Type":"ContainerStarted","Data":"088fbb077428eb6b6bb28ffd0072bf4c2bd59efc5f85c2397788c06fa11e7734"}
Jul 27 20:35:54.299000 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:54.298921    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-58gx2" podStartSLOduration=1.642888342 podStartE2EDuration="17.298907519s" totalImagesPullingTime="15.656019177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:35:54.298272778 +0000 UTC m=+52.902757654" watchObservedRunningTime="2026-07-27 20:35:54.298907519 +0000 UTC m=+52.903392394"
Jul 27 20:35:55.246988 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:55.246929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7mhr2"
Jul 27 20:35:55.744666 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:55.744630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:55.799198 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:55.799172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:56.433515 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:56.433488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:57.669880 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:57.669849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:57.770853 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:57.770819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:57.871288 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:57.871261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:58.289183 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:58.289145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:58.691918 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:58.691892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:59.222027 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:59.222005    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-769b64b76-5kxjb"
Jul 27 20:35:59.337889 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:59.337855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:59.445270 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:59.445246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:59.520756 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:59.520699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:35:59.625708 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:35:59.625685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:01.167061 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:01.167032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:01.270846 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:01.270820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:01.370062 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:01.370029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:01.737026 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:01.736994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:01.786307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:01.786282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.189520 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.189486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.235284 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.235250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"]
Jul 27 20:36:03.239628 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.239607    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gtnfd"]
Jul 27 20:36:03.239747 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.239728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.241792 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.241773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.242262 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.242245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:36:03.242357 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.242264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 20:36:03.242357 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.242301    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:36:03.242637 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.242619    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:36:03.243272 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.243255    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6dd48\""
Jul 27 20:36:03.243358 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.243296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 20:36:03.243417 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.243296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 20:36:03.243774 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.243760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:36:03.244047 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.244032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:36:03.244047 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.244039    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfz44\""
Jul 27 20:36:03.244163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.244070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:36:03.250300 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.250280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"]
Jul 27 20:36:03.267380 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-metrics-client-ca\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267464 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxnhk\" (UniqueName: \"kubernetes.io/projected/3de9c471-ea5b-44cc-b421-16547d1d77a1-kube-api-access-gxnhk\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267464 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-textfile\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267464 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267564 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.267564 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.267661 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-root\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267661 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fd95920-9649-4cac-8e58-0f6574495552-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.267661 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.267794 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-sys\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-wtmp\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.267838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-tls\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.268002 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-765tp\" (UniqueName: \"kubernetes.io/projected/6fd95920-9649-4cac-8e58-0f6574495552-kube-api-access-765tp\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.268002 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.268002 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.267909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.270008 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.269988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.353930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.353898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.368692 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.368769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-metrics-client-ca\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.368769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxnhk\" (UniqueName: \"kubernetes.io/projected/3de9c471-ea5b-44cc-b421-16547d1d77a1-kube-api-access-gxnhk\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.368835 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-textfile\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.368869 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.368925 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.368871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369058 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369136 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-root\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369193 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-textfile\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369193 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-root\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369297 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fd95920-9649-4cac-8e58-0f6574495552-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369297 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fd95920-9649-4cac-8e58-0f6574495552-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-sys\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-sys\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3de9c471-ea5b-44cc-b421-16547d1d77a1-metrics-client-ca\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-wtmp\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-tls\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.369839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd95920-9649-4cac-8e58-0f6574495552-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.370152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-765tp\" (UniqueName: \"kubernetes.io/projected/6fd95920-9649-4cac-8e58-0f6574495552-kube-api-access-765tp\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.370152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.370152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.369942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-wtmp\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.371397 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.371368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.371540 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.371523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd95920-9649-4cac-8e58-0f6574495552-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.371985 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.371951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-tls\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.372064 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.372015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3de9c471-ea5b-44cc-b421-16547d1d77a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.377791 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.377772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-765tp\" (UniqueName: \"kubernetes.io/projected/6fd95920-9649-4cac-8e58-0f6574495552-kube-api-access-765tp\") pod \"kube-state-metrics-56d9f944b4-s96nq\" (UID: \"6fd95920-9649-4cac-8e58-0f6574495552\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.378437 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.378411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxnhk\" (UniqueName: \"kubernetes.io/projected/3de9c471-ea5b-44cc-b421-16547d1d77a1-kube-api-access-gxnhk\") pod \"node-exporter-gtnfd\" (UID: \"3de9c471-ea5b-44cc-b421-16547d1d77a1\") " pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.454517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.454445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.549935 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.549912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"
Jul 27 20:36:03.554610 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.554587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.554713 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.554700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtnfd"
Jul 27 20:36:03.563587 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:03.563564    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de9c471_ea5b_44cc_b421_16547d1d77a1.slice/crio-90e184f8a3e928dbad7c023bdd16071bcb62604cd5414afd9c56d9f528e4ea29 WatchSource:0}: Error finding container 90e184f8a3e928dbad7c023bdd16071bcb62604cd5414afd9c56d9f528e4ea29: Status 404 returned error can't find the container with id 90e184f8a3e928dbad7c023bdd16071bcb62604cd5414afd9c56d9f528e4ea29
Jul 27 20:36:03.655496 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.655470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.667313 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.667291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq"]
Jul 27 20:36:03.670849 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:03.670826    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd95920_9649_4cac_8e58_0f6574495552.slice/crio-d61a7a2b48e0305309101d8191f403ea86848a4d08577d1ef57e06d887ec437e WatchSource:0}: Error finding container d61a7a2b48e0305309101d8191f403ea86848a4d08577d1ef57e06d887ec437e: Status 404 returned error can't find the container with id d61a7a2b48e0305309101d8191f403ea86848a4d08577d1ef57e06d887ec437e
Jul 27 20:36:03.790135 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.790051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:03.941552 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:03.941521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:04.200720 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.200673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:04.204562 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.204538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ndw6k"
Jul 27 20:36:04.289295 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.289265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:04.311177 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.311129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtnfd" event={"ID":"3de9c471-ea5b-44cc-b421-16547d1d77a1","Type":"ContainerStarted","Data":"90e184f8a3e928dbad7c023bdd16071bcb62604cd5414afd9c56d9f528e4ea29"}
Jul 27 20:36:04.312326 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.312298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq" event={"ID":"6fd95920-9649-4cac-8e58-0f6574495552","Type":"ContainerStarted","Data":"d61a7a2b48e0305309101d8191f403ea86848a4d08577d1ef57e06d887ec437e"}
Jul 27 20:36:04.408997 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.408946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:04.509587 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.509491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:04.845022 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:04.844919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:05.204191 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.204155    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-584d8b5bff-8vckb"]
Jul 27 20:36:05.207019 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.207000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.209911 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.209887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 27 20:36:05.210091 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.210072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hk5bh\""
Jul 27 20:36:05.210644 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.210627    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 27 20:36:05.210710 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.210671    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 27 20:36:05.210792 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.210776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 27 20:36:05.211023 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.211005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dfkhq9mlgs1rg\""
Jul 27 20:36:05.211110 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.211028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 27 20:36:05.235732 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.235689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584d8b5bff-8vckb"]
Jul 27 20:36:05.286460 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286595 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4b1489-e179-43f8-8f98-9a007806fdbe-metrics-client-ca\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286595 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286595 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-grpc-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7svw\" (UniqueName: \"kubernetes.io/projected/ed4b1489-e179-43f8-8f98-9a007806fdbe-kube-api-access-r7svw\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.286750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.286697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.317031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.317003    2563 generic.go:356] "Generic (PLEG): container finished" podID="3de9c471-ea5b-44cc-b421-16547d1d77a1" containerID="d82d79ee0efe850263adae09e4d1db03d46dd282db9144b93456978cb68a4133" exitCode=0
Jul 27 20:36:05.317152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.317098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtnfd" event={"ID":"3de9c471-ea5b-44cc-b421-16547d1d77a1","Type":"ContainerDied","Data":"d82d79ee0efe850263adae09e4d1db03d46dd282db9144b93456978cb68a4133"}
Jul 27 20:36:05.319382 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.319352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq" event={"ID":"6fd95920-9649-4cac-8e58-0f6574495552","Type":"ContainerStarted","Data":"4c57334105b35b09021cc0986aa35bb7ac85fca398f6eaac3b8f708bf52410d8"}
Jul 27 20:36:05.319488 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.319410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq" event={"ID":"6fd95920-9649-4cac-8e58-0f6574495552","Type":"ContainerStarted","Data":"c392ac562341a5257c37c488b7ee1f8052538c05c7587cd2755406e6cf65ceb7"}
Jul 27 20:36:05.319488 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.319439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq" event={"ID":"6fd95920-9649-4cac-8e58-0f6574495552","Type":"ContainerStarted","Data":"ef2ef25291c058399cc8dfea387c834de19f1de852d9c9af444f426414bcce42"}
Jul 27 20:36:05.352508 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.352458    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-s96nq" podStartSLOduration=1.107631217 podStartE2EDuration="2.352440151s" totalImagesPullingTime="1.244808934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:05.350527078 +0000 UTC m=+63.955011952" watchObservedRunningTime="2026-07-27 20:36:05.352440151 +0000 UTC m=+63.956925027"
Jul 27 20:36:05.387389 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4b1489-e179-43f8-8f98-9a007806fdbe-metrics-client-ca\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387470 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387470 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387543 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-grpc-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387618 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7svw\" (UniqueName: \"kubernetes.io/projected/ed4b1489-e179-43f8-8f98-9a007806fdbe-kube-api-access-r7svw\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387824 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.387947 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.388033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.387944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.388194 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.388144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed4b1489-e179-43f8-8f98-9a007806fdbe-metrics-client-ca\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.390626 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.390600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.390727 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.390631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.391008 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.390730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.391531 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.391504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-grpc-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.391617 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.391578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.392305 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.392281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ed4b1489-e179-43f8-8f98-9a007806fdbe-secret-thanos-querier-tls\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.395413 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.395397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7svw\" (UniqueName: \"kubernetes.io/projected/ed4b1489-e179-43f8-8f98-9a007806fdbe-kube-api-access-r7svw\") pod \"thanos-querier-584d8b5bff-8vckb\" (UID: \"ed4b1489-e179-43f8-8f98-9a007806fdbe\") " pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.517503 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.517433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:05.645340 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:05.645310    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-584d8b5bff-8vckb"]
Jul 27 20:36:05.648178 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:05.648155    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4b1489_e179_43f8_8f98_9a007806fdbe.slice/crio-a241229d1c59bb36d26d2373fc4eefd6d5a184067b68583c813bd3c646147fc2 WatchSource:0}: Error finding container a241229d1c59bb36d26d2373fc4eefd6d5a184067b68583c813bd3c646147fc2: Status 404 returned error can't find the container with id a241229d1c59bb36d26d2373fc4eefd6d5a184067b68583c813bd3c646147fc2
Jul 27 20:36:06.150307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.150279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:06.249072 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.249041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:06.326141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.326106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtnfd" event={"ID":"3de9c471-ea5b-44cc-b421-16547d1d77a1","Type":"ContainerStarted","Data":"7d58a7aa31e7f0c6278f14aadac9ca5cbdb03630ab5c2ede6936c608fbf7a0df"}
Jul 27 20:36:06.326316 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.326170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtnfd" event={"ID":"3de9c471-ea5b-44cc-b421-16547d1d77a1","Type":"ContainerStarted","Data":"39871f27489bc114902e81b0ae2cd4547278ba951ff935e06ace5add5eb340b1"}
Jul 27 20:36:06.327412 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.327381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"a241229d1c59bb36d26d2373fc4eefd6d5a184067b68583c813bd3c646147fc2"}
Jul 27 20:36:06.345895 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.345841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gtnfd" podStartSLOduration=2.303718195 podStartE2EDuration="3.345823041s" totalImagesPullingTime="971.877507ms" totalInitContainerRuntime="70.227339ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:06.345285746 +0000 UTC m=+64.949770662" watchObservedRunningTime="2026-07-27 20:36:06.345823041 +0000 UTC m=+64.950307918"
Jul 27 20:36:06.346450 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.346424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:06.446204 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:06.446176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:07.118441 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.118412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:07.173689 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.173651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:07.526348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.526318    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d585f8fc-zrzl8"]
Jul 27 20:36:07.541354 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.541319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d585f8fc-zrzl8"]
Jul 27 20:36:07.541499 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.541422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.544858 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.544808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 20:36:07.544858 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.544810    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-368ni3mpashpm\""
Jul 27 20:36:07.545145 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.544929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 20:36:07.545145 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.545004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 20:36:07.545281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.545155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8bf8q\""
Jul 27 20:36:07.545281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.545236    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 20:36:07.608520 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3872055a-363c-4d87-8cd8-44000d11d7af-audit-log\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608641 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-client-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608641 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-metrics-server-audit-profiles\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608641 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-tls\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:36:07.608743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwh8\" (UniqueName: \"kubernetes.io/projected/3872055a-363c-4d87-8cd8-44000d11d7af-kube-api-access-8bwh8\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.608832 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.608763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-client-certs\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.611303 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.611287    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:36:07.621280 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.621263    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:36:07.632346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.632324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7r6\" (UniqueName: \"kubernetes.io/projected/55a7cf9a-1257-4c44-9ed0-798c84413564-kube-api-access-tc7r6\") pod \"network-check-target-fpmx8\" (UID: \"55a7cf9a-1257-4c44-9ed0-798c84413564\") " pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:36:07.699628 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.699608    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pl2wx\""
Jul 27 20:36:07.708224 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.708208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:36:07.709552 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-metrics-server-audit-profiles\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709612 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-tls\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709612 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709737 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:36:07.709782 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwh8\" (UniqueName: \"kubernetes.io/projected/3872055a-363c-4d87-8cd8-44000d11d7af-kube-api-access-8bwh8\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709836 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-client-certs\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709886 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:36:07.709937 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3872055a-363c-4d87-8cd8-44000d11d7af-audit-log\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.709937 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.709909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-client-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.710351 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.710324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.710448 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.710415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3872055a-363c-4d87-8cd8-44000d11d7af-audit-log\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.710576 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.710555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3872055a-363c-4d87-8cd8-44000d11d7af-metrics-server-audit-profiles\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.711850 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.711833    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:36:07.711952 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.711924    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:36:07.711952 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.711940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-tls\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.712384 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.712365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-client-ca-bundle\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.712423 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.712404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3872055a-363c-4d87-8cd8-44000d11d7af-secret-metrics-server-client-certs\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.716769 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.716751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwh8\" (UniqueName: \"kubernetes.io/projected/3872055a-363c-4d87-8cd8-44000d11d7af-kube-api-access-8bwh8\") pod \"metrics-server-7d585f8fc-zrzl8\" (UID: \"3872055a-363c-4d87-8cd8-44000d11d7af\") " pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.722508 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.722490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0-metrics-certs\") pod \"network-metrics-daemon-wjv5r\" (UID: \"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0\") " pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:36:07.722732 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.722715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3295c789-7119-4780-9f0f-2e658d8b3bef-original-pull-secret\") pod \"global-pull-secret-syncer-hrhdg\" (UID: \"3295c789-7119-4780-9f0f-2e658d8b3bef\") " pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:36:07.851755 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.851718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:07.899505 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.899483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpmx8"]
Jul 27 20:36:07.902405 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:07.902381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a7cf9a_1257_4c44_9ed0_798c84413564.slice/crio-facf27718e200beb1826bc227337c77ef7f29787571bdc29026ef2dc0c9f4cb0 WatchSource:0}: Error finding container facf27718e200beb1826bc227337c77ef7f29787571bdc29026ef2dc0c9f4cb0: Status 404 returned error can't find the container with id facf27718e200beb1826bc227337c77ef7f29787571bdc29026ef2dc0c9f4cb0
Jul 27 20:36:07.987158 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.987132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrhdg"
Jul 27 20:36:07.995288 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:07.995181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kqrvq\""
Jul 27 20:36:08.003738 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.003717    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjv5r"
Jul 27 20:36:08.004063 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.004042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d585f8fc-zrzl8"]
Jul 27 20:36:08.006262 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.006244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"]
Jul 27 20:36:08.007091 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:08.007070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3872055a_363c_4d87_8cd8_44000d11d7af.slice/crio-02e530d66fcf04a293dce87ff3364757ba444eb431abed37f520a360aa4ccb3c WatchSource:0}: Error finding container 02e530d66fcf04a293dce87ff3364757ba444eb431abed37f520a360aa4ccb3c: Status 404 returned error can't find the container with id 02e530d66fcf04a293dce87ff3364757ba444eb431abed37f520a360aa4ccb3c
Jul 27 20:36:08.013459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.013437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:08.016150 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.016124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.019196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.018275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 20:36:08.019196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.018537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dx8ts\""
Jul 27 20:36:08.021565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.021511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"]
Jul 27 20:36:08.078721 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.078649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:08.112386 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.112351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhk8w\" (UniqueName: \"kubernetes.io/projected/ff95f7a1-7ef7-4def-a890-2c76a98809f7-kube-api-access-rhk8w\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.112557 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.112431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.170627 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.170603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrhdg"]
Jul 27 20:36:08.174537 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:08.174507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3295c789_7119_4780_9f0f_2e658d8b3bef.slice/crio-4c51756f98b8082d9d80faa2806bad75ecfb9c9cbbb07f76357ad3dc469afc3b WatchSource:0}: Error finding container 4c51756f98b8082d9d80faa2806bad75ecfb9c9cbbb07f76357ad3dc469afc3b: Status 404 returned error can't find the container with id 4c51756f98b8082d9d80faa2806bad75ecfb9c9cbbb07f76357ad3dc469afc3b
Jul 27 20:36:08.191245 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.191224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjv5r"]
Jul 27 20:36:08.193713 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:36:08.193690    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5a8994_a95e_4a7e_8fae_0b4ca1cd57b0.slice/crio-8a580019f8b9668b32d21e30bf16f69d836d0bd1b0e22e07bd88d8d75aa3c764 WatchSource:0}: Error finding container 8a580019f8b9668b32d21e30bf16f69d836d0bd1b0e22e07bd88d8d75aa3c764: Status 404 returned error can't find the container with id 8a580019f8b9668b32d21e30bf16f69d836d0bd1b0e22e07bd88d8d75aa3c764
Jul 27 20:36:08.195127 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.195102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:08.213257 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.213236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhk8w\" (UniqueName: \"kubernetes.io/projected/ff95f7a1-7ef7-4def-a890-2c76a98809f7-kube-api-access-rhk8w\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.213336 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.213289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.213404 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:36:08.213391    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 20:36:08.213463 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:36:08.213453    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert podName:ff95f7a1-7ef7-4def-a890-2c76a98809f7 nodeName:}" failed. No retries permitted until 2026-07-27 20:36:08.71343469 +0000 UTC m=+67.317919567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-k4zff" (UID: "ff95f7a1-7ef7-4def-a890-2c76a98809f7") : secret "monitoring-plugin-cert" not found
Jul 27 20:36:08.220774 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.220755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhk8w\" (UniqueName: \"kubernetes.io/projected/ff95f7a1-7ef7-4def-a890-2c76a98809f7-kube-api-access-rhk8w\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.246215 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.246192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:08.335725 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.335665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpmx8" event={"ID":"55a7cf9a-1257-4c44-9ed0-798c84413564","Type":"ContainerStarted","Data":"facf27718e200beb1826bc227337c77ef7f29787571bdc29026ef2dc0c9f4cb0"}
Jul 27 20:36:08.337622 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.337583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"1d5b003192bdcef9c0a993b77bf82235e319ab5d94ce931058f0ff91ed7d89d1"}
Jul 27 20:36:08.337723 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.337669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"6e9e40f33ff910e4e8f22f8cc4c796a3a952c367e7c738751f4219801f42f87b"}
Jul 27 20:36:08.337723 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.337713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"c25fe906f878e8e17fdafb1eafbc188250abb4459355bff5c05a317dda537d98"}
Jul 27 20:36:08.338658 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.338642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjv5r" event={"ID":"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0","Type":"ContainerStarted","Data":"8a580019f8b9668b32d21e30bf16f69d836d0bd1b0e22e07bd88d8d75aa3c764"}
Jul 27 20:36:08.339657 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.339626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrhdg" event={"ID":"3295c789-7119-4780-9f0f-2e658d8b3bef","Type":"ContainerStarted","Data":"4c51756f98b8082d9d80faa2806bad75ecfb9c9cbbb07f76357ad3dc469afc3b"}
Jul 27 20:36:08.340640 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.340607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8" event={"ID":"3872055a-363c-4d87-8cd8-44000d11d7af","Type":"ContainerStarted","Data":"02e530d66fcf04a293dce87ff3364757ba444eb431abed37f520a360aa4ccb3c"}
Jul 27 20:36:08.346332 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.346312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:08.717514 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.717481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.721946 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.720506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff95f7a1-7ef7-4def-a890-2c76a98809f7-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-k4zff\" (UID: \"ff95f7a1-7ef7-4def-a890-2c76a98809f7\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:08.931854 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:08.931818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:09.021166 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:09.021048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:09.122895 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:09.122852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:09.197368 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:09.196644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"]
Jul 27 20:36:09.349010 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:09.348841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"e2746f73522a3c242b46bb504097f8c9a6a2dc590d8e7acbdf6a537d34abf56f"}
Jul 27 20:36:09.421299 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:09.421268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:10.357817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.357778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"ac8b714db72ea429829c1c55f8f29e8e5a7e60b5b220e3bd1313c77631b947f5"}
Jul 27 20:36:10.358238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.357867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" event={"ID":"ed4b1489-e179-43f8-8f98-9a007806fdbe","Type":"ContainerStarted","Data":"05b0e7ecb731f6c5d8cb646e4caa2f994a4dc2f167e7387515b8907843fd7c33"}
Jul 27 20:36:10.358238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.358126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:10.361011 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.360898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjv5r" event={"ID":"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0","Type":"ContainerStarted","Data":"94923b9dd4ab2394886ea693d41345a7f8e3f45be8f49df4e030e20591079629"}
Jul 27 20:36:10.361011 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.360948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjv5r" event={"ID":"ef5a8994-a95e-4a7e-8fae-0b4ca1cd57b0","Type":"ContainerStarted","Data":"921f42ad98eaccf6fc5f6aa37e2241543a32c2425d6ac564ea44f3ac148bd94c"}
Jul 27 20:36:10.364910 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.364529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8" event={"ID":"3872055a-363c-4d87-8cd8-44000d11d7af","Type":"ContainerStarted","Data":"2556c75686b50e7b874dddd4cb0918fae5f99e22758c54d8456640599dc7cc75"}
Jul 27 20:36:10.366372 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.366349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff" event={"ID":"ff95f7a1-7ef7-4def-a890-2c76a98809f7","Type":"ContainerStarted","Data":"42085e7b64ad35b53b08ef94e474db757a09c55fc4815a098924b12890b593bc"}
Jul 27 20:36:10.382771 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.382725    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb" podStartSLOduration=2.312392406 podStartE2EDuration="5.382707175s" totalImagesPullingTime="3.070314769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:10.381039296 +0000 UTC m=+68.985524174" watchObservedRunningTime="2026-07-27 20:36:10.382707175 +0000 UTC m=+68.987192053"
Jul 27 20:36:10.399281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.399231    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8" podStartSLOduration=1.384359113 podStartE2EDuration="3.399215058s" totalImagesPullingTime="2.014855945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:10.397667712 +0000 UTC m=+69.002152587" watchObservedRunningTime="2026-07-27 20:36:10.399215058 +0000 UTC m=+69.003699937"
Jul 27 20:36:10.415025 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.414802    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wjv5r" podStartSLOduration=66.583105665 podStartE2EDuration="1m8.414790241s" totalImagesPullingTime="1.831684576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:10.413019599 +0000 UTC m=+69.017504475" watchObservedRunningTime="2026-07-27 20:36:10.414790241 +0000 UTC m=+69.019275115"
Jul 27 20:36:10.516369 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.516294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:10.577035 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.576942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:10.632176 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:10.632128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:13.377343 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:13.377311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:13.478615 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:13.478578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:14.384170 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.384133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrhdg" event={"ID":"3295c789-7119-4780-9f0f-2e658d8b3bef","Type":"ContainerStarted","Data":"9e060bc5485538d5d04864bb1425cb05ee5f4b76e16a125bdd68fb3fdcbe340f"}
Jul 27 20:36:14.385608 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.385578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff" event={"ID":"ff95f7a1-7ef7-4def-a890-2c76a98809f7","Type":"ContainerStarted","Data":"3ba913834848dd75e600d65fff5a4df4bece7b4e83b9468fa4ef78fcc0cf911f"}
Jul 27 20:36:14.385757 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.385704    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:14.387189 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.387164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpmx8" event={"ID":"55a7cf9a-1257-4c44-9ed0-798c84413564","Type":"ContainerStarted","Data":"85f094623122de5e63eb5d07f4d345283b87f1dff97fa44cda1245b15182648a"}
Jul 27 20:36:14.387316 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.387301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:36:14.390845 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.390822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff"
Jul 27 20:36:14.398229 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.398185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrhdg" podStartSLOduration=67.227699357 podStartE2EDuration="1m12.398169675s" totalImagesPullingTime="5.170470318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:14.397796142 +0000 UTC m=+73.002281020" watchObservedRunningTime="2026-07-27 20:36:14.398169675 +0000 UTC m=+73.002654552"
Jul 27 20:36:14.411455 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.411420    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fpmx8" podStartSLOduration=66.981788646 podStartE2EDuration="1m12.411408468s" totalImagesPullingTime="5.429619822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:14.410440375 +0000 UTC m=+73.014925253" watchObservedRunningTime="2026-07-27 20:36:14.411408468 +0000 UTC m=+73.015893343"
Jul 27 20:36:14.426128 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:14.426092    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-k4zff" podStartSLOduration=4.107786264 podStartE2EDuration="7.42607513s" totalImagesPullingTime="3.318288866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:36:14.425084348 +0000 UTC m=+73.029569223" watchObservedRunningTime="2026-07-27 20:36:14.42607513 +0000 UTC m=+73.030559996"
Jul 27 20:36:16.378290 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:16.378265    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-584d8b5bff-8vckb"
Jul 27 20:36:20.262154 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:20.262110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:20.361532 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:20.361506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:21.142489 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:21.142426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:21.199159 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:21.199113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:23.168356 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:23.168323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:24.299459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:24.299408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:24.410383 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:24.410358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:36:27.852589 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:27.852555    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:27.853017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:27.852625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:45.394007 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:45.393969    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fpmx8"
Jul 27 20:36:47.857784 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:47.857753    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:47.861462 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:47.861437    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d585f8fc-zrzl8"
Jul 27 20:36:50.213255 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:36:50.213215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:18.967778 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:18.967733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:19.309844 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:19.309756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:19.362867 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:19.362839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:25.367338 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:25.367303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:25.424587 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:25.424541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:25.513363 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:25.513336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:25.563427 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:25.563396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:26.116555 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:26.116518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:26.217433 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:26.217400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:31.203735 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:31.203703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:31.260180 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:31.260155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.146591 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.146555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.244584 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.244538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.346811 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.346781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.596240 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.596213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.696245 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.696216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:36.747709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:36.747685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:52.804943 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:52.804898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:37:52.860125 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:37:52.860092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:10.861437 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:10.861356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:11.447891 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:11.447857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:18.733515 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:18.733476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:18.825732 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:18.825697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:19.341482 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.341441    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"]
Jul 27 20:38:19.345099 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.345077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.347480 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.347461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:38:19.348314 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.348300    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:38:19.348364 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.348321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cwfxm\""
Jul 27 20:38:19.354528 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.354503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"]
Jul 27 20:38:19.466980 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.466923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbqbj\" (UniqueName: \"kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.467167 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.467001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.467167 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.467027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.568285 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.568251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbqbj\" (UniqueName: \"kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.568408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.568290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.568408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.568314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.568644 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.568625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.568684 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.568658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.576590 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.576561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbqbj\" (UniqueName: \"kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:19.654630 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:19.654543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:22.285887 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:38:22.285857    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe43726f_47b3_4168_bd2e_59dbff2288ab.slice/crio-c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab WatchSource:0}: Error finding container c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab: Status 404 returned error can't find the container with id c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab
Jul 27 20:38:22.819064 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:22.819023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9" event={"ID":"fe43726f-47b3-4168-bd2e-59dbff2288ab","Type":"ContainerStarted","Data":"c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab"}
Jul 27 20:38:29.848793 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:29.848756    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerID="4eb69b0ad770344be4e71d0fc7bd30eb0f47fe890aaf5937cfda086f4570e744" exitCode=0
Jul 27 20:38:29.849321 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:29.848822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9" event={"ID":"fe43726f-47b3-4168-bd2e-59dbff2288ab","Type":"ContainerDied","Data":"4eb69b0ad770344be4e71d0fc7bd30eb0f47fe890aaf5937cfda086f4570e744"}
Jul 27 20:38:42.793298 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:42.793264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:42.893216 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:42.893181    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerID="1e092869a409bfad7fbd301f8864b357a177a5c9f3ca64e1a0a17ed8f6934218" exitCode=0
Jul 27 20:38:42.893378 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:42.893249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9" event={"ID":"fe43726f-47b3-4168-bd2e-59dbff2288ab","Type":"ContainerDied","Data":"1e092869a409bfad7fbd301f8864b357a177a5c9f3ca64e1a0a17ed8f6934218"}
Jul 27 20:38:50.922889 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:50.922851    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerID="c769a37fed8544c18bca31dc104d56118c62543ccf6cdc45bfd9916404dca5e1" exitCode=0
Jul 27 20:38:50.923312 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:50.922934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9" event={"ID":"fe43726f-47b3-4168-bd2e-59dbff2288ab","Type":"ContainerDied","Data":"c769a37fed8544c18bca31dc104d56118c62543ccf6cdc45bfd9916404dca5e1"}
Jul 27 20:38:52.053977 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.053935    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:52.114496 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.114467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util\") pod \"fe43726f-47b3-4168-bd2e-59dbff2288ab\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") "
Jul 27 20:38:52.114683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.114514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle\") pod \"fe43726f-47b3-4168-bd2e-59dbff2288ab\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") "
Jul 27 20:38:52.114683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.114542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbqbj\" (UniqueName: \"kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj\") pod \"fe43726f-47b3-4168-bd2e-59dbff2288ab\" (UID: \"fe43726f-47b3-4168-bd2e-59dbff2288ab\") "
Jul 27 20:38:52.115347 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.115313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle" (OuterVolumeSpecName: "bundle") pod "fe43726f-47b3-4168-bd2e-59dbff2288ab" (UID: "fe43726f-47b3-4168-bd2e-59dbff2288ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:38:52.116713 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.116681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj" (OuterVolumeSpecName: "kube-api-access-nbqbj") pod "fe43726f-47b3-4168-bd2e-59dbff2288ab" (UID: "fe43726f-47b3-4168-bd2e-59dbff2288ab"). InnerVolumeSpecName "kube-api-access-nbqbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:38:52.119225 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.119200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util" (OuterVolumeSpecName: "util") pod "fe43726f-47b3-4168-bd2e-59dbff2288ab" (UID: "fe43726f-47b3-4168-bd2e-59dbff2288ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:38:52.215673 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.215602    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:38:52.215673 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.215626    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe43726f-47b3-4168-bd2e-59dbff2288ab-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:38:52.215673 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.215636    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbqbj\" (UniqueName: \"kubernetes.io/projected/fe43726f-47b3-4168-bd2e-59dbff2288ab-kube-api-access-nbqbj\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:38:52.933277 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.933239    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9"
Jul 27 20:38:52.933467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.933238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xrpg9" event={"ID":"fe43726f-47b3-4168-bd2e-59dbff2288ab","Type":"ContainerDied","Data":"c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab"}
Jul 27 20:38:52.933467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:52.933375    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c86d390bd45a6d7da8b936ae3886e6ee54c88015c7c677acf76d274f86053cab"
Jul 27 20:38:55.485389 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:55.485356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:56.352112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:56.352082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:57.460743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.460710    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"]
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461026    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="util"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461040    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="util"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461049    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="extract"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461055    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="extract"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461066    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="pull"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461071    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="pull"
Jul 27 20:38:57.461124 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.461122    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe43726f-47b3-4168-bd2e-59dbff2288ab" containerName="extract"
Jul 27 20:38:57.462852 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.462836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.464945 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.464918    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:38:57.464945 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.464923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 20:38:57.465166 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.465110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mmcq4\""
Jul 27 20:38:57.476499 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.476477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"]
Jul 27 20:38:57.550751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.550707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbck\" (UniqueName: \"kubernetes.io/projected/15bcada2-6f39-4abb-bb3a-85a59bab452b-kube-api-access-mkbck\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.550923 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.550815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15bcada2-6f39-4abb-bb3a-85a59bab452b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.651395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.651358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbck\" (UniqueName: \"kubernetes.io/projected/15bcada2-6f39-4abb-bb3a-85a59bab452b-kube-api-access-mkbck\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.651583 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.651411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15bcada2-6f39-4abb-bb3a-85a59bab452b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.651736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.651718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15bcada2-6f39-4abb-bb3a-85a59bab452b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.659407 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.659383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbck\" (UniqueName: \"kubernetes.io/projected/15bcada2-6f39-4abb-bb3a-85a59bab452b-kube-api-access-mkbck\") pod \"cert-manager-operator-controller-manager-55c444bf86-wrkpn\" (UID: \"15bcada2-6f39-4abb-bb3a-85a59bab452b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.771310 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.771232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"
Jul 27 20:38:57.903468 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.903442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn"]
Jul 27 20:38:57.906070 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:38:57.906043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bcada2_6f39_4abb_bb3a_85a59bab452b.slice/crio-746ca34be50c9717a9f468426bee6af64d90bc495af7e327c17f3a039282ec2b WatchSource:0}: Error finding container 746ca34be50c9717a9f468426bee6af64d90bc495af7e327c17f3a039282ec2b: Status 404 returned error can't find the container with id 746ca34be50c9717a9f468426bee6af64d90bc495af7e327c17f3a039282ec2b
Jul 27 20:38:57.956560 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:57.956532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn" event={"ID":"15bcada2-6f39-4abb-bb3a-85a59bab452b","Type":"ContainerStarted","Data":"746ca34be50c9717a9f468426bee6af64d90bc495af7e327c17f3a039282ec2b"}
Jul 27 20:38:59.160299 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:59.160248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:59.259638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:59.259602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:38:59.968314 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:38:59.968278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn" event={"ID":"15bcada2-6f39-4abb-bb3a-85a59bab452b","Type":"ContainerStarted","Data":"3a4a29c86b57edb7e5d8cbe53ffa4685d96384e737edbbd676e09088e22bca74"}
Jul 27 20:39:00.001958 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:00.001882    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wrkpn" podStartSLOduration=1.369850956 podStartE2EDuration="3.001868278s" totalImagesPullingTime="1.632017322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:38:59.999717661 +0000 UTC m=+238.604202537" watchObservedRunningTime="2026-07-27 20:39:00.001868278 +0000 UTC m=+238.606353153"
Jul 27 20:39:00.410829 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:00.410796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:00.525450 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:00.525419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:01.128860 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.128827    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"]
Jul 27 20:39:01.131188 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.131164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.133788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.133771    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cwfxm\""
Jul 27 20:39:01.134081 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.134068    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:39:01.134618 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.134601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:39:01.142812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.142788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"]
Jul 27 20:39:01.182775 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.182748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.182898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.182804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.182898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.182873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd24k\" (UniqueName: \"kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.283408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.283372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.283587 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.283439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd24k\" (UniqueName: \"kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.283587 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.283481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.283809 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.283790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.283868 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.283851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.295155 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.295125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:01.295448 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.295431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd24k\" (UniqueName: \"kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.399033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.398946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:01.399590 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.399571    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7zr6t"]
Jul 27 20:39:01.401891 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.401874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.404089 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.404073    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:39:01.404322 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.404308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:39:01.413204 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.413182    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7zr6t"]
Jul 27 20:39:01.440647 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.440627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:01.485935 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.485284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82nfk\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-kube-api-access-82nfk\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.485935 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.485330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.587519 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.587465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"]
Jul 27 20:39:01.588107 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.588083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82nfk\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-kube-api-access-82nfk\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.588221 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.588127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.591919 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:01.591893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962d9d24_da73_4e0d_8d99_68bfa9d6d9a3.slice/crio-243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f WatchSource:0}: Error finding container 243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f: Status 404 returned error can't find the container with id 243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f
Jul 27 20:39:01.600935 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.600912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.602208 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.602183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82nfk\" (UniqueName: \"kubernetes.io/projected/43dc49ef-3983-4f9e-acb3-9621628d8550-kube-api-access-82nfk\") pod \"cert-manager-webhook-6486ffd997-7zr6t\" (UID: \"43dc49ef-3983-4f9e-acb3-9621628d8550\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.720814 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.720785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:01.844187 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.844157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7zr6t"]
Jul 27 20:39:01.847425 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:01.847398    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43dc49ef_3983_4f9e_acb3_9621628d8550.slice/crio-65dbb57fdb8723f8b1474d3f40214be36173c3e634d9aaf001639e5035ac7917 WatchSource:0}: Error finding container 65dbb57fdb8723f8b1474d3f40214be36173c3e634d9aaf001639e5035ac7917: Status 404 returned error can't find the container with id 65dbb57fdb8723f8b1474d3f40214be36173c3e634d9aaf001639e5035ac7917
Jul 27 20:39:01.977235 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.977150    2563 generic.go:356] "Generic (PLEG): container finished" podID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerID="61bafe495c6b2e59bd1de7b9ab181dcd7d9e9f53e8fb8f81b55276f46a1032e3" exitCode=0
Jul 27 20:39:01.981196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.981171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerDied","Data":"61bafe495c6b2e59bd1de7b9ab181dcd7d9e9f53e8fb8f81b55276f46a1032e3"}
Jul 27 20:39:01.981307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.981213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerStarted","Data":"243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f"}
Jul 27 20:39:01.981307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:01.981227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t" event={"ID":"43dc49ef-3983-4f9e-acb3-9621628d8550","Type":"ContainerStarted","Data":"65dbb57fdb8723f8b1474d3f40214be36173c3e634d9aaf001639e5035ac7917"}
Jul 27 20:39:03.303184 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:03.303101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:03.708475 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:03.708438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:04.994518 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:04.994481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerStarted","Data":"856699dc296a492da44c8cc20dd32aab44bbbdd2324a05438d38b639f8034595"}
Jul 27 20:39:04.996122 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:04.996090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t" event={"ID":"43dc49ef-3983-4f9e-acb3-9621628d8550","Type":"ContainerStarted","Data":"8cf7e79d96e288300acf830344362c462e70bfe27049ccc255173a029fee7410"}
Jul 27 20:39:04.996243 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:04.996226    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:05.068455 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:05.068412    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t" podStartSLOduration=0.98975734 podStartE2EDuration="4.068397191s" totalImagesPullingTime="3.078639851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:05.067294295 +0000 UTC m=+243.671779185" watchObservedRunningTime="2026-07-27 20:39:05.068397191 +0000 UTC m=+243.672882066"
Jul 27 20:39:05.897793 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:05.897759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:05.998364 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:05.998329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:06.000840 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:06.000816    2563 generic.go:356] "Generic (PLEG): container finished" podID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerID="856699dc296a492da44c8cc20dd32aab44bbbdd2324a05438d38b639f8034595" exitCode=0
Jul 27 20:39:06.001028 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:06.000902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerDied","Data":"856699dc296a492da44c8cc20dd32aab44bbbdd2324a05438d38b639f8034595"}
Jul 27 20:39:07.007123 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:07.007086    2563 generic.go:356] "Generic (PLEG): container finished" podID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerID="0c216a4ff5f00809514e02ddaa5efc0d541bff1e532c5ae2f9009679f81a0f71" exitCode=0
Jul 27 20:39:07.007512 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:07.007145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerDied","Data":"0c216a4ff5f00809514e02ddaa5efc0d541bff1e532c5ae2f9009679f81a0f71"}
Jul 27 20:39:08.135838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.135815    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:08.243640 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.243600    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util\") pod \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") "
Jul 27 20:39:08.243640 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.243654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd24k\" (UniqueName: \"kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k\") pod \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") "
Jul 27 20:39:08.243873 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.243682    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle\") pod \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\" (UID: \"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3\") "
Jul 27 20:39:08.244092 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.244063    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle" (OuterVolumeSpecName: "bundle") pod "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" (UID: "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:39:08.245741 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.245716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k" (OuterVolumeSpecName: "kube-api-access-pd24k") pod "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" (UID: "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3"). InnerVolumeSpecName "kube-api-access-pd24k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:39:08.248376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.248341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util" (OuterVolumeSpecName: "util") pod "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" (UID: "962d9d24-da73-4e0d-8d99-68bfa9d6d9a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:39:08.344417 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.344343    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:08.344417 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.344371    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:08.344417 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:08.344384    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd24k\" (UniqueName: \"kubernetes.io/projected/962d9d24-da73-4e0d-8d99-68bfa9d6d9a3-kube-api-access-pd24k\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:09.016619 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:09.016592    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g"
Jul 27 20:39:09.016619 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:09.016597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6g87g" event={"ID":"962d9d24-da73-4e0d-8d99-68bfa9d6d9a3","Type":"ContainerDied","Data":"243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f"}
Jul 27 20:39:09.016813 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:09.016636    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="243bd77ed64102cf26b75e4ccfb21a0eeb50abb73d3477f6a3272fff907a9c0f"
Jul 27 20:39:11.003699 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:11.003667    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7zr6t"
Jul 27 20:39:11.932216 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:11.932174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:15.512835 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:15.512800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:15.614125 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:15.614092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:16.936708 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936674    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"]
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936934    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="util"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936945    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="util"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936981    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="extract"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936987    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="extract"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.936999    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="pull"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.937004    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="pull"
Jul 27 20:39:16.937095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.937051    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="962d9d24-da73-4e0d-8d99-68bfa9d6d9a3" containerName="extract"
Jul 27 20:39:16.998358 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.998332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"]
Jul 27 20:39:16.998506 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:16.998417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.000907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.000876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ns4xb\""
Jul 27 20:39:17.000907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.000904    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 20:39:17.001097 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.000904    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:39:17.108243 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.108212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbwz\" (UniqueName: \"kubernetes.io/projected/836aea92-df8e-4752-b6cc-0732d21f4261-kube-api-access-jgbwz\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.108404 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.108259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836aea92-df8e-4752-b6cc-0732d21f4261-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.208612 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.208533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbwz\" (UniqueName: \"kubernetes.io/projected/836aea92-df8e-4752-b6cc-0732d21f4261-kube-api-access-jgbwz\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.208612 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.208585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836aea92-df8e-4752-b6cc-0732d21f4261-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.208932 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.208916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836aea92-df8e-4752-b6cc-0732d21f4261-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.221204 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.221171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbwz\" (UniqueName: \"kubernetes.io/projected/836aea92-df8e-4752-b6cc-0732d21f4261-kube-api-access-jgbwz\") pod \"openshift-lws-operator-fd8ccff4c-2fqp2\" (UID: \"836aea92-df8e-4752-b6cc-0732d21f4261\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.307179 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.307150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"
Jul 27 20:39:17.450296 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:17.450260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2"]
Jul 27 20:39:17.453698 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:17.453668    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod836aea92_df8e_4752_b6cc_0732d21f4261.slice/crio-bf318d1ff8c949edc4a7d835fa29c628e0b6244af6f1ef2676c41716d7e60336 WatchSource:0}: Error finding container bf318d1ff8c949edc4a7d835fa29c628e0b6244af6f1ef2676c41716d7e60336: Status 404 returned error can't find the container with id bf318d1ff8c949edc4a7d835fa29c628e0b6244af6f1ef2676c41716d7e60336
Jul 27 20:39:18.053622 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:18.053586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2" event={"ID":"836aea92-df8e-4752-b6cc-0732d21f4261","Type":"ContainerStarted","Data":"bf318d1ff8c949edc4a7d835fa29c628e0b6244af6f1ef2676c41716d7e60336"}
Jul 27 20:39:30.595199 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:30.595122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:31.973104 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:31.973072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:33.119017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:33.118983    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2" event={"ID":"836aea92-df8e-4752-b6cc-0732d21f4261","Type":"ContainerStarted","Data":"e0652b1d427db2fe69b2f5c0877f89df7850f7256515d130510010d512b60866"}
Jul 27 20:39:33.139752 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:33.139700    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2fqp2" podStartSLOduration=2.318516449 podStartE2EDuration="17.139683528s" totalImagesPullingTime="14.821167079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:33.13890473 +0000 UTC m=+271.743389605" watchObservedRunningTime="2026-07-27 20:39:33.139683528 +0000 UTC m=+271.744168405"
Jul 27 20:39:33.886672 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:33.886634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:33.986628 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:33.986599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:34.769307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.769273    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"]
Jul 27 20:39:34.771836 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.771803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:34.777313 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.777292    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:39:34.778109 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.778093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cwfxm\""
Jul 27 20:39:34.778232 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.778167    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:39:34.787064 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.787041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"]
Jul 27 20:39:34.933800 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.933754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:34.934006 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.933851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpphf\" (UniqueName: \"kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:34.934006 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:34.933920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.035117 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.035029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpphf\" (UniqueName: \"kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.035117 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.035073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.035117 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.035096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.035415 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.035398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.035467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.035438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.045490 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.045468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpphf\" (UniqueName: \"kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.080946 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.080925    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:35.211066 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:35.211037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"]
Jul 27 20:39:35.213004 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:35.212953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d9433e_e7b1_4d6b_a00e_0dac439736eb.slice/crio-435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b WatchSource:0}: Error finding container 435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b: Status 404 returned error can't find the container with id 435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b
Jul 27 20:39:36.102238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:36.102210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:36.133815 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:36.133787    2563 generic.go:356] "Generic (PLEG): container finished" podID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerID="59f4d847d3e299d92f85e29b2924b6ef0cc1e2e43d4a278e38fbd9fc63466ce4" exitCode=0
Jul 27 20:39:36.133956 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:36.133871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m" event={"ID":"69d9433e-e7b1-4d6b-a00e-0dac439736eb","Type":"ContainerDied","Data":"59f4d847d3e299d92f85e29b2924b6ef0cc1e2e43d4a278e38fbd9fc63466ce4"}
Jul 27 20:39:36.133956 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:36.133921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m" event={"ID":"69d9433e-e7b1-4d6b-a00e-0dac439736eb","Type":"ContainerStarted","Data":"435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b"}
Jul 27 20:39:37.140161 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:37.140066    2563 generic.go:356] "Generic (PLEG): container finished" podID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerID="4ff1ff30fe40241a1c09c926d360a3ea1f3fb3c6e47fd64d84760d5abaf99fc5" exitCode=0
Jul 27 20:39:37.140161 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:37.140126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m" event={"ID":"69d9433e-e7b1-4d6b-a00e-0dac439736eb","Type":"ContainerDied","Data":"4ff1ff30fe40241a1c09c926d360a3ea1f3fb3c6e47fd64d84760d5abaf99fc5"}
Jul 27 20:39:38.146517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:38.146480    2563 generic.go:356] "Generic (PLEG): container finished" podID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerID="1768cf109ceb92883f956b64cdfa70ae182cbf06f11dd8e770a9d1cc6f97be9a" exitCode=0
Jul 27 20:39:38.146879 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:38.146565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m" event={"ID":"69d9433e-e7b1-4d6b-a00e-0dac439736eb","Type":"ContainerDied","Data":"1768cf109ceb92883f956b64cdfa70ae182cbf06f11dd8e770a9d1cc6f97be9a"}
Jul 27 20:39:39.266619 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.266595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:39.369581 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.369551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpphf\" (UniqueName: \"kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf\") pod \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") "
Jul 27 20:39:39.369761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.369595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle\") pod \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") "
Jul 27 20:39:39.369761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.369618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util\") pod \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\" (UID: \"69d9433e-e7b1-4d6b-a00e-0dac439736eb\") "
Jul 27 20:39:39.370343 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.370315    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle" (OuterVolumeSpecName: "bundle") pod "69d9433e-e7b1-4d6b-a00e-0dac439736eb" (UID: "69d9433e-e7b1-4d6b-a00e-0dac439736eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:39:39.371572 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.371544    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf" (OuterVolumeSpecName: "kube-api-access-kpphf") pod "69d9433e-e7b1-4d6b-a00e-0dac439736eb" (UID: "69d9433e-e7b1-4d6b-a00e-0dac439736eb"). InnerVolumeSpecName "kube-api-access-kpphf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:39:39.374602 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.374568    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util" (OuterVolumeSpecName: "util") pod "69d9433e-e7b1-4d6b-a00e-0dac439736eb" (UID: "69d9433e-e7b1-4d6b-a00e-0dac439736eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:39:39.470617 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.470587    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpphf\" (UniqueName: \"kubernetes.io/projected/69d9433e-e7b1-4d6b-a00e-0dac439736eb-kube-api-access-kpphf\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:39.470617 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.470614    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:39.470770 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.470626    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69d9433e-e7b1-4d6b-a00e-0dac439736eb-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:39:39.803218 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.803133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:39.901510 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:39.901476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:40.155565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.155484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m" event={"ID":"69d9433e-e7b1-4d6b-a00e-0dac439736eb","Type":"ContainerDied","Data":"435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b"}
Jul 27 20:39:40.155565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.155522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjbg7m"
Jul 27 20:39:40.155565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.155529    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="435f3d9af09f01735c0158ed4da2c2ac2594124f174a8b5cc455996d45c7076b"
Jul 27 20:39:40.406846 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.406762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:40.506882 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.506851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"]
Jul 27 20:39:40.507131 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507120    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="extract"
Jul 27 20:39:40.507178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507133    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="extract"
Jul 27 20:39:40.507178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507146    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="util"
Jul 27 20:39:40.507178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507151    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="util"
Jul 27 20:39:40.507178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507166    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="pull"
Jul 27 20:39:40.507178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507172    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="pull"
Jul 27 20:39:40.507329 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.507212    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="69d9433e-e7b1-4d6b-a00e-0dac439736eb" containerName="extract"
Jul 27 20:39:40.509309 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.509290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.512025 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.512007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 20:39:40.512468 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.512451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 20:39:40.512539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.512494    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 20:39:40.512934 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.512920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-57br9\""
Jul 27 20:39:40.522178 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.522157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"]
Jul 27 20:39:40.530105 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.530082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:40.679826 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.679800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.679954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.679863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-manager-config\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.679954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.679882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2jjc\" (UniqueName: \"kubernetes.io/projected/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-kube-api-access-q2jjc\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.679954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.679899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-metrics-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.780503 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.780472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-manager-config\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.780639 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.780507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2jjc\" (UniqueName: \"kubernetes.io/projected/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-kube-api-access-q2jjc\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.780639 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.780532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-metrics-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.780639 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.780571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.781245 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.781224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-manager-config\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.782995 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.782976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.783079 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.783023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-metrics-cert\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.788144 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.788122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2jjc\" (UniqueName: \"kubernetes.io/projected/b9c9620e-82ac-4da3-a7b2-66b44e3024d6-kube-api-access-q2jjc\") pod \"lws-controller-manager-67d8f5d499-r78pn\" (UID: \"b9c9620e-82ac-4da3-a7b2-66b44e3024d6\") " pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.818031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.818009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:40.941710 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:40.941688    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"]
Jul 27 20:39:40.943799 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:40.943770    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c9620e_82ac_4da3_a7b2_66b44e3024d6.slice/crio-211cd006e5f98123caa33729b678a11e52fd38f4bf4c64e68a6bbd3078537be1 WatchSource:0}: Error finding container 211cd006e5f98123caa33729b678a11e52fd38f4bf4c64e68a6bbd3078537be1: Status 404 returned error can't find the container with id 211cd006e5f98123caa33729b678a11e52fd38f4bf4c64e68a6bbd3078537be1
Jul 27 20:39:41.160422 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:41.160383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn" event={"ID":"b9c9620e-82ac-4da3-a7b2-66b44e3024d6","Type":"ContainerStarted","Data":"211cd006e5f98123caa33729b678a11e52fd38f4bf4c64e68a6bbd3078537be1"}
Jul 27 20:39:43.173018 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:43.172981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn" event={"ID":"b9c9620e-82ac-4da3-a7b2-66b44e3024d6","Type":"ContainerStarted","Data":"5a9232e73f95340c823a0dcae913f920742fc5e807e5d911f47a003e9b5a4f75"}
Jul 27 20:39:43.173430 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:43.173121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:43.193076 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:43.193030    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn" podStartSLOduration=1.713770667 podStartE2EDuration="3.193015955s" totalImagesPullingTime="1.479245288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:43.190788122 +0000 UTC m=+281.795272999" watchObservedRunningTime="2026-07-27 20:39:43.193015955 +0000 UTC m=+281.797500831"
Jul 27 20:39:50.604992 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:50.604943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:50.700222 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:50.700189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:51.224477 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.224451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:51.815445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.815414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:51.913984 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.913940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:51.968364 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.968341    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"]
Jul 27 20:39:51.971144 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.971124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:51.975446 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.975425    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:39:51.975570 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.975539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:39:51.975679 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.975545    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:39:51.975679 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.975545    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:39:51.975924 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.975909    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ln5pk\""
Jul 27 20:39:51.993054 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:51.993035    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"]
Jul 27 20:39:52.067738 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.067666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.067738 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.067698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzg2z\" (UniqueName: \"kubernetes.io/projected/b2642eb3-ec30-4bb5-9b0b-f57182315611-kube-api-access-jzg2z\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.067738 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.067717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.067909 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.067833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.067909 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.067870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.133271 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.133240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:52.168449 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.168535 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzg2z\" (UniqueName: \"kubernetes.io/projected/b2642eb3-ec30-4bb5-9b0b-f57182315611-kube-api-access-jzg2z\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.168535 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.168535 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.168645 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.168873 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.168854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-manifests\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.170763 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.170744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2642eb3-ec30-4bb5-9b0b-f57182315611-tmp\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.170897 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.170881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.171101 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.171081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2642eb3-ec30-4bb5-9b0b-f57182315611-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.176360 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.176339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzg2z\" (UniqueName: \"kubernetes.io/projected/b2642eb3-ec30-4bb5-9b0b-f57182315611-kube-api-access-jzg2z\") pod \"opendatahub-operator-controller-manager-9b945668b-ht6n6\" (UID: \"b2642eb3-ec30-4bb5-9b0b-f57182315611\") " pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.232023 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.231994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:52.281259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.281230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:52.336421 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.336201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:52.436597 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.436562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:52.474433 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.474414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"]
Jul 27 20:39:52.476921 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:39:52.476895    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2642eb3_ec30_4bb5_9b0b_f57182315611.slice/crio-74c5fcc1bde06b967125f115f8c8492630d481cd07b8809f8f2e9dc419cc979c WatchSource:0}: Error finding container 74c5fcc1bde06b967125f115f8c8492630d481cd07b8809f8f2e9dc419cc979c: Status 404 returned error can't find the container with id 74c5fcc1bde06b967125f115f8c8492630d481cd07b8809f8f2e9dc419cc979c
Jul 27 20:39:52.569475 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.569444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:52.660766 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:52.660733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:53.219828 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:53.219795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6" event={"ID":"b2642eb3-ec30-4bb5-9b0b-f57182315611","Type":"ContainerStarted","Data":"74c5fcc1bde06b967125f115f8c8492630d481cd07b8809f8f2e9dc419cc979c"}
Jul 27 20:39:53.627469 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:53.627366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:53.774420 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:53.774391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:39:54.181063 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:54.181029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67d8f5d499-r78pn"
Jul 27 20:39:56.237520 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:56.237487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6" event={"ID":"b2642eb3-ec30-4bb5-9b0b-f57182315611","Type":"ContainerStarted","Data":"aee406f6b0c6b08532794c0c7375a1aff2cdeced0e185854b695dc367b8460e8"}
Jul 27 20:39:57.243052 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:57.243012    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2642eb3-ec30-4bb5-9b0b-f57182315611" containerID="aee406f6b0c6b08532794c0c7375a1aff2cdeced0e185854b695dc367b8460e8" exitCode=0
Jul 27 20:39:57.243424 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:57.243092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6" event={"ID":"b2642eb3-ec30-4bb5-9b0b-f57182315611","Type":"ContainerDied","Data":"aee406f6b0c6b08532794c0c7375a1aff2cdeced0e185854b695dc367b8460e8"}
Jul 27 20:39:58.249283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:58.249238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6" event={"ID":"b2642eb3-ec30-4bb5-9b0b-f57182315611","Type":"ContainerStarted","Data":"0adfc83b69bce50fcab8ff546fe9972f38e6abafa3636cb5920f5083052d266d"}
Jul 27 20:39:58.249662 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:58.249352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:39:58.283013 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:39:58.282951    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6" podStartSLOduration=2.5931913079999998 podStartE2EDuration="7.282937633s" totalImagesPullingTime="3.651629136s" totalInitContainerRuntime="1.038117189s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:39:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:39:58.281519482 +0000 UTC m=+296.886004391" watchObservedRunningTime="2026-07-27 20:39:58.282937633 +0000 UTC m=+296.887422508"
Jul 27 20:40:01.804378 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:01.804349    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:40:08.129062 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:08.129028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:08.229584 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:08.229552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:08.558691 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:08.558662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:08.622121 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:08.622092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:09.256326 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:09.256295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b945668b-ht6n6"
Jul 27 20:40:09.768237 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:09.768203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:11.971740 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:11.971706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:12.200921 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:12.200891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:12.996461 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:12.996430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:13.215954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:13.215910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:13.398152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:13.398058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:14.215719 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:14.215685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:14.765476 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:14.765447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:18.545622 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:18.545591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:19.009431 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:19.009384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:21.300322 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:21.300280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:21.459756 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:21.459726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:24.711138 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:24.711109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:25.819421 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.819388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:25.932659 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.932619    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"]
Jul 27 20:40:25.936084 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.936060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:25.939191 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.939165    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sw92b\""
Jul 27 20:40:25.939933 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.939915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 20:40:25.945462 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.945441    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"]
Jul 27 20:40:25.948707 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.948692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:25.956854 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.956836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 20:40:25.956949 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.956913    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5mrjd\""
Jul 27 20:40:25.959868 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.959848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"]
Jul 27 20:40:25.982574 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.982550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"]
Jul 27 20:40:25.988870 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:25.988846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:26.036548 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.036523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zr69\" (UniqueName: \"kubernetes.io/projected/b06fb06f-9477-4820-ab61-4d06b81e839e-kube-api-access-6zr69\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.036685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.036555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f43fcd8d-8205-4011-92d9-d6c503313080-cert\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.036685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.036639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b06fb06f-9477-4820-ab61-4d06b81e839e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.036763 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.036690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckd2\" (UniqueName: \"kubernetes.io/projected/f43fcd8d-8205-4011-92d9-d6c503313080-kube-api-access-dckd2\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.137712 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.137633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b06fb06f-9477-4820-ab61-4d06b81e839e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.137712 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.137670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckd2\" (UniqueName: \"kubernetes.io/projected/f43fcd8d-8205-4011-92d9-d6c503313080-kube-api-access-dckd2\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.137895 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.137799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zr69\" (UniqueName: \"kubernetes.io/projected/b06fb06f-9477-4820-ab61-4d06b81e839e-kube-api-access-6zr69\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.137895 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.137831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f43fcd8d-8205-4011-92d9-d6c503313080-cert\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.140141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.140113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b06fb06f-9477-4820-ab61-4d06b81e839e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.140264 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.140184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f43fcd8d-8205-4011-92d9-d6c503313080-cert\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.160682 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.160653    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckd2\" (UniqueName: \"kubernetes.io/projected/f43fcd8d-8205-4011-92d9-d6c503313080-kube-api-access-dckd2\") pod \"kserve-controller-manager-d6f4b65b8-ss7qk\" (UID: \"f43fcd8d-8205-4011-92d9-d6c503313080\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.169275 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.169245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zr69\" (UniqueName: \"kubernetes.io/projected/b06fb06f-9477-4820-ab61-4d06b81e839e-kube-api-access-6zr69\") pod \"llmisvc-controller-manager-777c6bd7d5-glhfw\" (UID: \"b06fb06f-9477-4820-ab61-4d06b81e839e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.239989 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.239950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:26.246977 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.246941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:26.257082 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.257062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:26.413170 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.413133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"]
Jul 27 20:40:26.415561 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:40:26.415535    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43fcd8d_8205_4011_92d9_d6c503313080.slice/crio-471bf44e3b40770c61ea15c5f7564af747a403f365b42d2f1a037a39983364bc WatchSource:0}: Error finding container 471bf44e3b40770c61ea15c5f7564af747a403f365b42d2f1a037a39983364bc: Status 404 returned error can't find the container with id 471bf44e3b40770c61ea15c5f7564af747a403f365b42d2f1a037a39983364bc
Jul 27 20:40:26.416823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.416807    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:40:26.440167 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.440139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:26.443160 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:26.443140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"]
Jul 27 20:40:26.445849 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:40:26.445829    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb06fb06f_9477_4820_ab61_4d06b81e839e.slice/crio-9408f56fdc27c2d0587f25342dd9c5e4a6c849b5a449c26a4296e8e1f33bd240 WatchSource:0}: Error finding container 9408f56fdc27c2d0587f25342dd9c5e4a6c849b5a449c26a4296e8e1f33bd240: Status 404 returned error can't find the container with id 9408f56fdc27c2d0587f25342dd9c5e4a6c849b5a449c26a4296e8e1f33bd240
Jul 27 20:40:27.213152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.213108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:27.374608 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.374545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw" event={"ID":"b06fb06f-9477-4820-ab61-4d06b81e839e","Type":"ContainerStarted","Data":"9408f56fdc27c2d0587f25342dd9c5e4a6c849b5a449c26a4296e8e1f33bd240"}
Jul 27 20:40:27.376169 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.376134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk" event={"ID":"f43fcd8d-8205-4011-92d9-d6c503313080","Type":"ContainerStarted","Data":"471bf44e3b40770c61ea15c5f7564af747a403f365b42d2f1a037a39983364bc"}
Jul 27 20:40:27.421880 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.421851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:27.571566 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.571480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:27.732903 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:27.732868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:28.363082 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.363014    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"]
Jul 27 20:40:28.366754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.366727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.376411 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.376386    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-btpvp\""
Jul 27 20:40:28.377023 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.376953    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:40:28.377318 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.377299    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:40:28.377957 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.377937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:40:28.412334 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.412309    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"]
Jul 27 20:40:28.456582 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456731 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456731 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456731 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456863 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456863 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b204c45e-2b4d-4202-a387-3f29ef70101c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456863 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456986 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.456986 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.456911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97sbp\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-kube-api-access-97sbp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.494793 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.494761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:28.558022 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.557984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558201 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558201 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97sbp\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-kube-api-access-97sbp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558201 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558201 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558458 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558504 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558555 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558555 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b204c45e-2b4d-4202-a387-3f29ef70101c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558717 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.558929 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.558906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.559371 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.559350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b204c45e-2b4d-4202-a387-3f29ef70101c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.561008 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.560856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.561299 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.561276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.579217 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.579193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.579570 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.579546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97sbp\" (UniqueName: \"kubernetes.io/projected/b204c45e-2b4d-4202-a387-3f29ef70101c-kube-api-access-97sbp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj\" (UID: \"b204c45e-2b4d-4202-a387-3f29ef70101c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.680577 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.680548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:28.813248 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:28.813169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:29.024082 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:29.024010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:40:30.002090 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.002063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"]
Jul 27 20:40:30.014477 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:40:30.014454    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb204c45e_2b4d_4202_a387_3f29ef70101c.slice/crio-5ad94674c27a116ccb957151ca284c24d8732b0fb4693831c268e8661102ea05 WatchSource:0}: Error finding container 5ad94674c27a116ccb957151ca284c24d8732b0fb4693831c268e8661102ea05: Status 404 returned error can't find the container with id 5ad94674c27a116ccb957151ca284c24d8732b0fb4693831c268e8661102ea05
Jul 27 20:40:30.398727 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.398695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk" event={"ID":"f43fcd8d-8205-4011-92d9-d6c503313080","Type":"ContainerStarted","Data":"44e0e3c0bb31f3726791f73f687b02170839e519c565edc71a98309da4be82a9"}
Jul 27 20:40:30.398919 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.398808    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:40:30.399863 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.399836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj" event={"ID":"b204c45e-2b4d-4202-a387-3f29ef70101c","Type":"ContainerStarted","Data":"5ad94674c27a116ccb957151ca284c24d8732b0fb4693831c268e8661102ea05"}
Jul 27 20:40:30.401064 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.401044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw" event={"ID":"b06fb06f-9477-4820-ab61-4d06b81e839e","Type":"ContainerStarted","Data":"79d24af9ff0a7575e7c6e86bff3a3ea5cf0c7ecb30fdbfdaee965acd20a33374"}
Jul 27 20:40:30.401175 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.401164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:40:30.425762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.425722    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk" podStartSLOduration=1.997602117 podStartE2EDuration="5.425709746s" totalImagesPullingTime="3.428107629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:30.424592367 +0000 UTC m=+329.029077241" watchObservedRunningTime="2026-07-27 20:40:30.425709746 +0000 UTC m=+329.030194621"
Jul 27 20:40:30.451647 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:30.451608    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw" podStartSLOduration=2.048177845 podStartE2EDuration="5.451596182s" totalImagesPullingTime="3.403418337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:30.45052541 +0000 UTC m=+329.055010285" watchObservedRunningTime="2026-07-27 20:40:30.451596182 +0000 UTC m=+329.056081056"
Jul 27 20:40:33.977821 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:33.977782    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:40:33.978203 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:33.977853    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:40:33.978203 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:33.977882    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:40:34.422920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:34.422882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj" event={"ID":"b204c45e-2b4d-4202-a387-3f29ef70101c","Type":"ContainerStarted","Data":"1098df4bfffb49a30f5d4deeb842512a9332d7cc42ca56c63e837ed6f60d94fd"}
Jul 27 20:40:34.472235 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:34.472179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj" podStartSLOduration=2.51097943 podStartE2EDuration="6.472141842s" totalImagesPullingTime="3.961162412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:40:34.471519686 +0000 UTC m=+333.076004561" watchObservedRunningTime="2026-07-27 20:40:34.472141842 +0000 UTC m=+333.076626716"
Jul 27 20:40:34.681395 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:34.681313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:35.685452 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:35.685425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:36.431466 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:36.431434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:40:36.432260 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:40:36.432241    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj"
Jul 27 20:41:01.410296 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:01.410214    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-glhfw"
Jul 27 20:41:01.413224 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:01.413200    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ss7qk"
Jul 27 20:41:13.335374 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.335334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:13.431442 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.431406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:13.473281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.473239    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:13.485606 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.485578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:13.485771 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.485697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:13.488193 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.488172    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:41:13.488325 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.488214    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:41:13.489272 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.489249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cr95r\""
Jul 27 20:41:13.532750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.532716    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:13.629312 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.629213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcqg\" (UniqueName: \"kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg\") pod \"kuadrant-operator-catalog-7sbhz\" (UID: \"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0\") " pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:13.729779 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.729743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcqg\" (UniqueName: \"kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg\") pod \"kuadrant-operator-catalog-7sbhz\" (UID: \"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0\") " pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:13.741104 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.741075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcqg\" (UniqueName: \"kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg\") pod \"kuadrant-operator-catalog-7sbhz\" (UID: \"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0\") " pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:13.798307 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.798265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:13.846815 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.846784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:13.924695 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:13.924672    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:13.926729 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:13.926701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3e8a9f_d420_4ba6_8f10_7ddae0dd35e0.slice/crio-24f89dca41da4662e445f8169e97e0baa6aaf046bb2af365ace6594e900d7a47 WatchSource:0}: Error finding container 24f89dca41da4662e445f8169e97e0baa6aaf046bb2af365ace6594e900d7a47: Status 404 returned error can't find the container with id 24f89dca41da4662e445f8169e97e0baa6aaf046bb2af365ace6594e900d7a47
Jul 27 20:41:14.044497 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.044461    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqxbp"]
Jul 27 20:41:14.049179 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.049158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:14.058231 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.058207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqxbp"]
Jul 27 20:41:14.111143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.111109    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.133881 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.133850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzjp\" (UniqueName: \"kubernetes.io/projected/ab73b538-f1c5-4145-97d3-23c53371dbe2-kube-api-access-xhzjp\") pod \"kuadrant-operator-catalog-nqxbp\" (UID: \"ab73b538-f1c5-4145-97d3-23c53371dbe2\") " pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:14.170385 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.170352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.234781 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.234702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzjp\" (UniqueName: \"kubernetes.io/projected/ab73b538-f1c5-4145-97d3-23c53371dbe2-kube-api-access-xhzjp\") pod \"kuadrant-operator-catalog-nqxbp\" (UID: \"ab73b538-f1c5-4145-97d3-23c53371dbe2\") " pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:14.242858 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.242830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzjp\" (UniqueName: \"kubernetes.io/projected/ab73b538-f1c5-4145-97d3-23c53371dbe2-kube-api-access-xhzjp\") pod \"kuadrant-operator-catalog-nqxbp\" (UID: \"ab73b538-f1c5-4145-97d3-23c53371dbe2\") " pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:14.250944 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.250916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.351844 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.351809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.359751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.359727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:14.467821 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.467793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.564266 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.564227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqxbp"]
Jul 27 20:41:14.600144 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.600115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" event={"ID":"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0","Type":"ContainerStarted","Data":"24f89dca41da4662e445f8169e97e0baa6aaf046bb2af365ace6594e900d7a47"}
Jul 27 20:41:14.637513 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:14.637484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab73b538_f1c5_4145_97d3_23c53371dbe2.slice/crio-b64acf2e18494ad42e044fe4de5d9fabbb839a845ec972b4a186750bfd2d879e WatchSource:0}: Error finding container b64acf2e18494ad42e044fe4de5d9fabbb839a845ec972b4a186750bfd2d879e: Status 404 returned error can't find the container with id b64acf2e18494ad42e044fe4de5d9fabbb839a845ec972b4a186750bfd2d879e
Jul 27 20:41:14.847493 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.847418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:14.910196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:14.910161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:15.607678 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:15.607640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp" event={"ID":"ab73b538-f1c5-4145-97d3-23c53371dbe2","Type":"ContainerStarted","Data":"b64acf2e18494ad42e044fe4de5d9fabbb839a845ec972b4a186750bfd2d879e"}
Jul 27 20:41:16.613407 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.613362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp" event={"ID":"ab73b538-f1c5-4145-97d3-23c53371dbe2","Type":"ContainerStarted","Data":"a4548426698cabd45f180ba6b0e98793057a78483a830a9fdd171a66a69df7c1"}
Jul 27 20:41:16.614901 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.614874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" event={"ID":"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0","Type":"ContainerStarted","Data":"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"}
Jul 27 20:41:16.615037 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.614917    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" podUID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" containerName="registry-server" containerID="cri-o://9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b" gracePeriod=2
Jul 27 20:41:16.630687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.630643    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp" podStartSLOduration=1.373871829 podStartE2EDuration="2.630627985s" totalImagesPullingTime="1.256756156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:16.628169796 +0000 UTC m=+375.232654673" watchObservedRunningTime="2026-07-27 20:41:16.630627985 +0000 UTC m=+375.235112838"
Jul 27 20:41:16.644032 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.643993    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" podStartSLOduration=1.679613218 podStartE2EDuration="3.643979679s" totalImagesPullingTime="1.964366461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:16.641976379 +0000 UTC m=+375.246461254" watchObservedRunningTime="2026-07-27 20:41:16.643979679 +0000 UTC m=+375.248464547"
Jul 27 20:41:16.857048 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.857025    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:16.960073 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.960039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdcqg\" (UniqueName: \"kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg\") pod \"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0\" (UID: \"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0\") "
Jul 27 20:41:16.962240 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:16.962212    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg" (OuterVolumeSpecName: "kube-api-access-sdcqg") pod "da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" (UID: "da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0"). InnerVolumeSpecName "kube-api-access-sdcqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:17.061002 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.060782    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdcqg\" (UniqueName: \"kubernetes.io/projected/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0-kube-api-access-sdcqg\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:17.620638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.620606    2563 generic.go:356] "Generic (PLEG): container finished" podID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" containerID="9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b" exitCode=0
Jul 27 20:41:17.621046 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.620657    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz"
Jul 27 20:41:17.621046 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.620691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" event={"ID":"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0","Type":"ContainerDied","Data":"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"}
Jul 27 20:41:17.621046 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.620740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7sbhz" event={"ID":"da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0","Type":"ContainerDied","Data":"24f89dca41da4662e445f8169e97e0baa6aaf046bb2af365ace6594e900d7a47"}
Jul 27 20:41:17.621046 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.620760    2563 scope.go:117] "RemoveContainer" containerID="9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"
Jul 27 20:41:17.630238 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.630218    2563 scope.go:117] "RemoveContainer" containerID="9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"
Jul 27 20:41:17.630471 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:41:17.630451    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b\": container with ID starting with 9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b not found: ID does not exist" containerID="9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"
Jul 27 20:41:17.630517 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.630483    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b"} err="failed to get container status \"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b\": rpc error: code = NotFound desc = could not find container \"9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b\": container with ID starting with 9665196642e6204411b1406c95a569a6097949369ec1e1d114a971905f3f842b not found: ID does not exist"
Jul 27 20:41:17.640885 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.640861    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:17.645983 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.645942    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7sbhz"]
Jul 27 20:41:17.983327 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:17.983294    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" path="/var/lib/kubelet/pods/da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0/volumes"
Jul 27 20:41:19.615898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:19.615868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:19.672614 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:19.672580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:21.464569 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:21.464520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:21.565479 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:21.565442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:24.360733 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:24.360695    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:24.361280 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:24.360755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:24.382494 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:24.382468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:24.672422 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:24.672395    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nqxbp"
Jul 27 20:41:25.508721 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:25.508687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:25.565702 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:25.565667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:25.638351 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:25.638307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:25.736500 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:25.736469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:28.874669 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.874631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"]
Jul 27 20:41:28.875068 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.874972    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" containerName="registry-server"
Jul 27 20:41:28.875068 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.874987    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" containerName="registry-server"
Jul 27 20:41:28.875068 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.875050    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3e8a9f-d420-4ba6-8f10-7ddae0dd35e0" containerName="registry-server"
Jul 27 20:41:28.877881 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.877863    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:28.880027 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.880009    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2mk4\""
Jul 27 20:41:28.885605 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.885588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"]
Jul 27 20:41:28.961050 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.961018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4b7\" (UniqueName: \"kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:28.961196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.961075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:28.961196 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:28.961133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.062400 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.062371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4b7\" (UniqueName: \"kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.062528 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.062405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.062528 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.062432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.062882 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.062857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.062928 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.062866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.071788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.071764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4b7\" (UniqueName: \"kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.187920 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.187885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:29.319465 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.319437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"]
Jul 27 20:41:29.321662 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:29.321633    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98a07da_8d4b_498f_be26_9d29ee62d5e7.slice/crio-986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f WatchSource:0}: Error finding container 986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f: Status 404 returned error can't find the container with id 986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f
Jul 27 20:41:29.479676 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.479606    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"]
Jul 27 20:41:29.482955 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.482939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.490374 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.490350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"]
Jul 27 20:41:29.566914 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.566883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkxrw\" (UniqueName: \"kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.567065 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.566947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.567107 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.567076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.668333 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.668299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.668472 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.668354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkxrw\" (UniqueName: \"kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.668472 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.668404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.668761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.668741    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.668761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.668754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.675711 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.675683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkxrw\" (UniqueName: \"kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.681726 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.681703    2563 generic.go:356] "Generic (PLEG): container finished" podID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerID="89218a89c576e3e3a8ff110795301eda01d2e90c282b1656f2b582cad8fe8f51" exitCode=0
Jul 27 20:41:29.681825 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.681756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2" event={"ID":"a98a07da-8d4b-498f-be26-9d29ee62d5e7","Type":"ContainerDied","Data":"89218a89c576e3e3a8ff110795301eda01d2e90c282b1656f2b582cad8fe8f51"}
Jul 27 20:41:29.681825 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.681787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2" event={"ID":"a98a07da-8d4b-498f-be26-9d29ee62d5e7","Type":"ContainerStarted","Data":"986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f"}
Jul 27 20:41:29.792080 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.792013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:29.875053 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.875020    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"]
Jul 27 20:41:29.879761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.879738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:29.886629 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.886516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"]
Jul 27 20:41:29.921562 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.921537    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"]
Jul 27 20:41:29.923699 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:29.923667    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd83344_9392_4a23_959d_b2f3102de726.slice/crio-045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d WatchSource:0}: Error finding container 045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d: Status 404 returned error can't find the container with id 045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d
Jul 27 20:41:29.970826 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.970800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:29.970898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.970846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:29.970958 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:29.970938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds986\" (UniqueName: \"kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.072031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.071925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.072031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.071993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.072031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.072021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds986\" (UniqueName: \"kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.072415 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.072316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.072415 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.072390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.079803 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.079774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds986\" (UniqueName: \"kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.190839 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.190801    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:30.284799 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.284761    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"]
Jul 27 20:41:30.290916 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.290891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.296398 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.296331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"]
Jul 27 20:41:30.328832 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.328811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"]
Jul 27 20:41:30.342951 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:30.342925    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc81d914_c1fa_4990_bdab_48704bacbb37.slice/crio-a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5 WatchSource:0}: Error finding container a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5: Status 404 returned error can't find the container with id a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5
Jul 27 20:41:30.374862 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.374834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.374999 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.374878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mjx\" (UniqueName: \"kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.374999 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.374989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.475754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.475688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.475754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.475746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mjx\" (UniqueName: \"kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.475932 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.475853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.476151 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.476127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.476205 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.476138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.484417 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.484392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mjx\" (UniqueName: \"kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.604838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.604749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:30.693055 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.693020    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerID="0592faa32203f2f2e965fa37ecb144200f8c56562c18b405d4dd2a4320710324" exitCode=0
Jul 27 20:41:30.693353 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.693074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6" event={"ID":"fc81d914-c1fa-4990-bdab-48704bacbb37","Type":"ContainerDied","Data":"0592faa32203f2f2e965fa37ecb144200f8c56562c18b405d4dd2a4320710324"}
Jul 27 20:41:30.693688 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.693420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6" event={"ID":"fc81d914-c1fa-4990-bdab-48704bacbb37","Type":"ContainerStarted","Data":"a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5"}
Jul 27 20:41:30.695630 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.695604    2563 generic.go:356] "Generic (PLEG): container finished" podID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerID="55f845e12ddf16acfdaff03625f2614ba1751f685c0932f2acafb15cf1f79367" exitCode=0
Jul 27 20:41:30.695833 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.695688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2" event={"ID":"a98a07da-8d4b-498f-be26-9d29ee62d5e7","Type":"ContainerDied","Data":"55f845e12ddf16acfdaff03625f2614ba1751f685c0932f2acafb15cf1f79367"}
Jul 27 20:41:30.697780 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.697757    2563 generic.go:356] "Generic (PLEG): container finished" podID="cfd83344-9392-4a23-959d-b2f3102de726" containerID="e660fec65218824e3c90ea615396b6749f630f32e807c4378440bd2b3ca00c72" exitCode=0
Jul 27 20:41:30.697889 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.697836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt" event={"ID":"cfd83344-9392-4a23-959d-b2f3102de726","Type":"ContainerDied","Data":"e660fec65218824e3c90ea615396b6749f630f32e807c4378440bd2b3ca00c72"}
Jul 27 20:41:30.697984 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.697919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt" event={"ID":"cfd83344-9392-4a23-959d-b2f3102de726","Type":"ContainerStarted","Data":"045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d"}
Jul 27 20:41:30.741685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:30.741377    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"]
Jul 27 20:41:30.743827 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:30.743797    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8237d713_fc21_4a19_908a_84ec9c1472d5.slice/crio-0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216 WatchSource:0}: Error finding container 0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216: Status 404 returned error can't find the container with id 0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216
Jul 27 20:41:31.709054 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.709024    2563 generic.go:356] "Generic (PLEG): container finished" podID="cfd83344-9392-4a23-959d-b2f3102de726" containerID="b2624dfc752a2d9571899aad89c83a151ebcd8243fecdeba7bb153e2482b56af" exitCode=0
Jul 27 20:41:31.709494 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.709110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt" event={"ID":"cfd83344-9392-4a23-959d-b2f3102de726","Type":"ContainerDied","Data":"b2624dfc752a2d9571899aad89c83a151ebcd8243fecdeba7bb153e2482b56af"}
Jul 27 20:41:31.710948 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.710925    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerID="78889c6b762a9dfca944094a78380c86a87bfb8dd025ea44c02726c6f1902726" exitCode=0
Jul 27 20:41:31.711063 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.710997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6" event={"ID":"fc81d914-c1fa-4990-bdab-48704bacbb37","Type":"ContainerDied","Data":"78889c6b762a9dfca944094a78380c86a87bfb8dd025ea44c02726c6f1902726"}
Jul 27 20:41:31.712531 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.712506    2563 generic.go:356] "Generic (PLEG): container finished" podID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerID="715a5bb1799426587c7d90cc030ab2287516447b309c9a3e7e9fc6a29045f132" exitCode=0
Jul 27 20:41:31.712641 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.712589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc" event={"ID":"8237d713-fc21-4a19-908a-84ec9c1472d5","Type":"ContainerDied","Data":"715a5bb1799426587c7d90cc030ab2287516447b309c9a3e7e9fc6a29045f132"}
Jul 27 20:41:31.712750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.712636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc" event={"ID":"8237d713-fc21-4a19-908a-84ec9c1472d5","Type":"ContainerStarted","Data":"0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216"}
Jul 27 20:41:31.714932 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.714906    2563 generic.go:356] "Generic (PLEG): container finished" podID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerID="8026bba80f219e245d7d4aaae7c5ee3a62f681d483ce83163f52f5f15b70685a" exitCode=0
Jul 27 20:41:31.715058 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:31.714941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2" event={"ID":"a98a07da-8d4b-498f-be26-9d29ee62d5e7","Type":"ContainerDied","Data":"8026bba80f219e245d7d4aaae7c5ee3a62f681d483ce83163f52f5f15b70685a"}
Jul 27 20:41:32.721609 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.721581    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerID="7f7252e59b35a5bc95719154db86e7c66cad43af99db9786060e20a4433e13d3" exitCode=0
Jul 27 20:41:32.721943 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.721625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6" event={"ID":"fc81d914-c1fa-4990-bdab-48704bacbb37","Type":"ContainerDied","Data":"7f7252e59b35a5bc95719154db86e7c66cad43af99db9786060e20a4433e13d3"}
Jul 27 20:41:32.724236 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.724209    2563 generic.go:356] "Generic (PLEG): container finished" podID="cfd83344-9392-4a23-959d-b2f3102de726" containerID="245afbde1d5645dd71a4a0da20c7f3572d841ab1a7feb438c4f602ba5dcb6fa5" exitCode=0
Jul 27 20:41:32.724475 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.724444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt" event={"ID":"cfd83344-9392-4a23-959d-b2f3102de726","Type":"ContainerDied","Data":"245afbde1d5645dd71a4a0da20c7f3572d841ab1a7feb438c4f602ba5dcb6fa5"}
Jul 27 20:41:32.859488 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.859463    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:32.999375 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.999291    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh4b7\" (UniqueName: \"kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7\") pod \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") "
Jul 27 20:41:32.999375 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.999350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util\") pod \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") "
Jul 27 20:41:32.999557 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.999386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle\") pod \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\" (UID: \"a98a07da-8d4b-498f-be26-9d29ee62d5e7\") "
Jul 27 20:41:32.999907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:32.999875    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle" (OuterVolumeSpecName: "bundle") pod "a98a07da-8d4b-498f-be26-9d29ee62d5e7" (UID: "a98a07da-8d4b-498f-be26-9d29ee62d5e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:33.001512 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.001478    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7" (OuterVolumeSpecName: "kube-api-access-jh4b7") pod "a98a07da-8d4b-498f-be26-9d29ee62d5e7" (UID: "a98a07da-8d4b-498f-be26-9d29ee62d5e7"). InnerVolumeSpecName "kube-api-access-jh4b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:33.004831 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.004812    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util" (OuterVolumeSpecName: "util") pod "a98a07da-8d4b-498f-be26-9d29ee62d5e7" (UID: "a98a07da-8d4b-498f-be26-9d29ee62d5e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:33.100163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.100124    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:33.100163 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.100159    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a98a07da-8d4b-498f-be26-9d29ee62d5e7-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:33.100334 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.100172    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh4b7\" (UniqueName: \"kubernetes.io/projected/a98a07da-8d4b-498f-be26-9d29ee62d5e7-kube-api-access-jh4b7\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:33.731317 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.731282    2563 generic.go:356] "Generic (PLEG): container finished" podID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerID="1b4d2c33053398147fd2c90df0fa8e781a5a837d29a75413217c4828876d2a30" exitCode=0
Jul 27 20:41:33.731784 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.731374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc" event={"ID":"8237d713-fc21-4a19-908a-84ec9c1472d5","Type":"ContainerDied","Data":"1b4d2c33053398147fd2c90df0fa8e781a5a837d29a75413217c4828876d2a30"}
Jul 27 20:41:33.733317 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.733296    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2"
Jul 27 20:41:33.733317 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.733304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2" event={"ID":"a98a07da-8d4b-498f-be26-9d29ee62d5e7","Type":"ContainerDied","Data":"986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f"}
Jul 27 20:41:33.733449 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.733345    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="986ece7af2e1b6f2eef9fddf86bf166b5864b4c288945b878ccbae32c879ef2f"
Jul 27 20:41:33.881540 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.881515    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:33.938750 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:33.938727    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:34.008611 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.008502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds986\" (UniqueName: \"kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986\") pod \"fc81d914-c1fa-4990-bdab-48704bacbb37\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") "
Jul 27 20:41:34.008611 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.008601    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle\") pod \"fc81d914-c1fa-4990-bdab-48704bacbb37\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") "
Jul 27 20:41:34.008843 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.008645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util\") pod \"fc81d914-c1fa-4990-bdab-48704bacbb37\" (UID: \"fc81d914-c1fa-4990-bdab-48704bacbb37\") "
Jul 27 20:41:34.009246 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.009218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle" (OuterVolumeSpecName: "bundle") pod "fc81d914-c1fa-4990-bdab-48704bacbb37" (UID: "fc81d914-c1fa-4990-bdab-48704bacbb37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:34.010844 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.010811    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986" (OuterVolumeSpecName: "kube-api-access-ds986") pod "fc81d914-c1fa-4990-bdab-48704bacbb37" (UID: "fc81d914-c1fa-4990-bdab-48704bacbb37"). InnerVolumeSpecName "kube-api-access-ds986". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:34.014650 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.014622    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util" (OuterVolumeSpecName: "util") pod "fc81d914-c1fa-4990-bdab-48704bacbb37" (UID: "fc81d914-c1fa-4990-bdab-48704bacbb37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:34.109536 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle\") pod \"cfd83344-9392-4a23-959d-b2f3102de726\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") "
Jul 27 20:41:34.109709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkxrw\" (UniqueName: \"kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw\") pod \"cfd83344-9392-4a23-959d-b2f3102de726\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") "
Jul 27 20:41:34.109709 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util\") pod \"cfd83344-9392-4a23-959d-b2f3102de726\" (UID: \"cfd83344-9392-4a23-959d-b2f3102de726\") "
Jul 27 20:41:34.109823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109770    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.109823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109780    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds986\" (UniqueName: \"kubernetes.io/projected/fc81d914-c1fa-4990-bdab-48704bacbb37-kube-api-access-ds986\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.109823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.109790    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc81d914-c1fa-4990-bdab-48704bacbb37-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.110123 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.110083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle" (OuterVolumeSpecName: "bundle") pod "cfd83344-9392-4a23-959d-b2f3102de726" (UID: "cfd83344-9392-4a23-959d-b2f3102de726"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:34.111639 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.111614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw" (OuterVolumeSpecName: "kube-api-access-pkxrw") pod "cfd83344-9392-4a23-959d-b2f3102de726" (UID: "cfd83344-9392-4a23-959d-b2f3102de726"). InnerVolumeSpecName "kube-api-access-pkxrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:34.115065 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.115030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util" (OuterVolumeSpecName: "util") pod "cfd83344-9392-4a23-959d-b2f3102de726" (UID: "cfd83344-9392-4a23-959d-b2f3102de726"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:34.210367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.210340    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.210367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.210362    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkxrw\" (UniqueName: \"kubernetes.io/projected/cfd83344-9392-4a23-959d-b2f3102de726-kube-api-access-pkxrw\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.210367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.210372    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfd83344-9392-4a23-959d-b2f3102de726-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:34.739675 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.739639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6" event={"ID":"fc81d914-c1fa-4990-bdab-48704bacbb37","Type":"ContainerDied","Data":"a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5"}
Jul 27 20:41:34.740090 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.739689    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0693a026c5222a6910bd9a04772009454aa757285523d42c622d20bacb3d4f5"
Jul 27 20:41:34.740090 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.739652    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6"
Jul 27 20:41:34.741784 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.741760    2563 generic.go:356] "Generic (PLEG): container finished" podID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerID="65ef405dd666e4dea4cf0f13de19cb8b14d4fd5c35e55c5a1d018b35a2ddea4c" exitCode=0
Jul 27 20:41:34.741900 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.741835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc" event={"ID":"8237d713-fc21-4a19-908a-84ec9c1472d5","Type":"ContainerDied","Data":"65ef405dd666e4dea4cf0f13de19cb8b14d4fd5c35e55c5a1d018b35a2ddea4c"}
Jul 27 20:41:34.743660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.743642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt" event={"ID":"cfd83344-9392-4a23-959d-b2f3102de726","Type":"ContainerDied","Data":"045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d"}
Jul 27 20:41:34.743754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.743668    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt"
Jul 27 20:41:34.743754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:34.743673    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="045844f9de0f27267819287014415f87830a6e47f31962acbad4abf985ed936d"
Jul 27 20:41:35.875023 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:35.875000    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:36.023794 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.023705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle\") pod \"8237d713-fc21-4a19-908a-84ec9c1472d5\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") "
Jul 27 20:41:36.023943 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.023814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util\") pod \"8237d713-fc21-4a19-908a-84ec9c1472d5\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") "
Jul 27 20:41:36.023943 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.023838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mjx\" (UniqueName: \"kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx\") pod \"8237d713-fc21-4a19-908a-84ec9c1472d5\" (UID: \"8237d713-fc21-4a19-908a-84ec9c1472d5\") "
Jul 27 20:41:36.024277 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.024244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle" (OuterVolumeSpecName: "bundle") pod "8237d713-fc21-4a19-908a-84ec9c1472d5" (UID: "8237d713-fc21-4a19-908a-84ec9c1472d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:36.025937 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.025915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx" (OuterVolumeSpecName: "kube-api-access-m8mjx") pod "8237d713-fc21-4a19-908a-84ec9c1472d5" (UID: "8237d713-fc21-4a19-908a-84ec9c1472d5"). InnerVolumeSpecName "kube-api-access-m8mjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:41:36.031762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.031737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util" (OuterVolumeSpecName: "util") pod "8237d713-fc21-4a19-908a-84ec9c1472d5" (UID: "8237d713-fc21-4a19-908a-84ec9c1472d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:41:36.124643 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.124608    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-util\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:36.124643 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.124639    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mjx\" (UniqueName: \"kubernetes.io/projected/8237d713-fc21-4a19-908a-84ec9c1472d5-kube-api-access-m8mjx\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:36.124643 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.124650    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8237d713-fc21-4a19-908a-84ec9c1472d5-bundle\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:41:36.754828 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.754800    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc"
Jul 27 20:41:36.755017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.754837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc" event={"ID":"8237d713-fc21-4a19-908a-84ec9c1472d5","Type":"ContainerDied","Data":"0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216"}
Jul 27 20:41:36.755017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:36.754885    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a18cf950b278ca453b2874b2b1e4b86bf7a70fce75cad81669d29dcb868b216"
Jul 27 20:41:42.308208 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:42.308171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:46.512247 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:46.512215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:48.393552 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393517    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"]
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393873    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="util"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393885    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="util"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393895    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="pull"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393900    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="pull"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393909    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="util"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393915    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="util"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393921    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="pull"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393926    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="pull"
Jul 27 20:41:48.393930 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393934    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="util"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393942    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="util"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393952    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393958    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393982    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="util"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="util"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393993    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.393998    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394008    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="pull"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394014    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="pull"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394022    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394030    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394036    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394041    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394053    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="pull"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394058    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="pull"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394114    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd83344-9392-4a23-959d-b2f3102de726" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394121    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc81d914-c1fa-4990-bdab-48704bacbb37" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394127    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98a07da-8d4b-498f-be26-9d29ee62d5e7" containerName="extract"
Jul 27 20:41:48.394219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.394131    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8237d713-fc21-4a19-908a-84ec9c1472d5" containerName="extract"
Jul 27 20:41:48.400386 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.400365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:48.403605 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.403581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cmm6q\""
Jul 27 20:41:48.403712 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.403605    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 20:41:48.408210 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.408191    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"]
Jul 27 20:41:48.427311 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.427243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k846l\" (UniqueName: \"kubernetes.io/projected/e6090f9d-7086-4eb1-8fb3-524cace6cd9c-kube-api-access-k846l\") pod \"dns-operator-controller-manager-864dd78c4c-dm2kj\" (UID: \"e6090f9d-7086-4eb1-8fb3-524cace6cd9c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:48.528758 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.528725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k846l\" (UniqueName: \"kubernetes.io/projected/e6090f9d-7086-4eb1-8fb3-524cace6cd9c-kube-api-access-k846l\") pod \"dns-operator-controller-manager-864dd78c4c-dm2kj\" (UID: \"e6090f9d-7086-4eb1-8fb3-524cace6cd9c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:48.540759 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.540738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k846l\" (UniqueName: \"kubernetes.io/projected/e6090f9d-7086-4eb1-8fb3-524cace6cd9c-kube-api-access-k846l\") pod \"dns-operator-controller-manager-864dd78c4c-dm2kj\" (UID: \"e6090f9d-7086-4eb1-8fb3-524cace6cd9c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:48.711467 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.711435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:48.845671 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:48.845646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"]
Jul 27 20:41:48.848340 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:48.848313    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6090f9d_7086_4eb1_8fb3_524cace6cd9c.slice/crio-2b508b64127b3a316994d967186337b5c1af87c424ef72109461bb1dbdcdaa97 WatchSource:0}: Error finding container 2b508b64127b3a316994d967186337b5c1af87c424ef72109461bb1dbdcdaa97: Status 404 returned error can't find the container with id 2b508b64127b3a316994d967186337b5c1af87c424ef72109461bb1dbdcdaa97
Jul 27 20:41:49.097894 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:49.097811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:49.821273 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:49.821234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj" event={"ID":"e6090f9d-7086-4eb1-8fb3-524cace6cd9c","Type":"ContainerStarted","Data":"2b508b64127b3a316994d967186337b5c1af87c424ef72109461bb1dbdcdaa97"}
Jul 27 20:41:50.860719 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:50.860680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:51.834100 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:51.834063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj" event={"ID":"e6090f9d-7086-4eb1-8fb3-524cace6cd9c","Type":"ContainerStarted","Data":"275de36e57ca893addf0d2bcb5ed606f85742760f39dbfbe23af02fb97ebd0ff"}
Jul 27 20:41:51.834292 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:51.834122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:41:51.853304 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:51.853261    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj" podStartSLOduration=1.737279156 podStartE2EDuration="3.853237783s" totalImagesPullingTime="2.115958627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:41:51.851890239 +0000 UTC m=+410.456375113" watchObservedRunningTime="2026-07-27 20:41:51.853237783 +0000 UTC m=+410.457722658"
Jul 27 20:41:52.192133 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:52.192101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:53.392553 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.392514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"]
Jul 27 20:41:53.395850 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.395833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.398441 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.398425    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z8smn\""
Jul 27 20:41:53.410420 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.410397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"]
Jul 27 20:41:53.471425 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.471389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvlp\" (UniqueName: \"kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.471589 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.471453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.572786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.572749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvlp\" (UniqueName: \"kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.572974 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.572889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.573268 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.573249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.582484 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.582451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvlp\" (UniqueName: \"kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.706265 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.706216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:41:53.709989 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.709934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:53.871445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.871414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"]
Jul 27 20:41:53.873686 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:41:53.873657    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d18e197_4ef4_461f_b1ab_12ec52c1e941.slice/crio-e35cf7d529b601163e0d8bfabdca502b597b3485ead77da6af06f22058f8737d WatchSource:0}: Error finding container e35cf7d529b601163e0d8bfabdca502b597b3485ead77da6af06f22058f8737d: Status 404 returned error can't find the container with id e35cf7d529b601163e0d8bfabdca502b597b3485ead77da6af06f22058f8737d
Jul 27 20:41:53.976449 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:53.976354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:54.377906 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:54.377801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:54.854870 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:54.854835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc" event={"ID":"5d18e197-4ef4-461f-b1ab-12ec52c1e941","Type":"ContainerStarted","Data":"e35cf7d529b601163e0d8bfabdca502b597b3485ead77da6af06f22058f8737d"}
Jul 27 20:41:56.535421 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:56.535362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:58.708288 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:58.708253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:41:58.808059 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:41:58.808027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:00.809680 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:00.809646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:00.879158 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:00.879125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:01.893031 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:01.892995    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc" event={"ID":"5d18e197-4ef4-461f-b1ab-12ec52c1e941","Type":"ContainerStarted","Data":"d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8"}
Jul 27 20:42:01.893410 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:01.893107    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:01.911904 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:01.911859    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc" podStartSLOduration=1.4714209839999999 podStartE2EDuration="8.911845407s" totalImagesPullingTime="7.440424423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:01.910032117 +0000 UTC m=+420.514516993" watchObservedRunningTime="2026-07-27 20:42:01.911845407 +0000 UTC m=+420.516330382"
Jul 27 20:42:02.841704 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:02.841671    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dm2kj"
Jul 27 20:42:04.174876 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.174842    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"]
Jul 27 20:42:04.179638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.179614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.181785 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.181766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 20:42:04.181897 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.181864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l2mk4\""
Jul 27 20:42:04.182057 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.182040    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 20:42:04.187737 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.187718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"]
Jul 27 20:42:04.189488 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.189463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:04.267003 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.266949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.267158 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.267056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb1c2cbe-5a8d-49da-b182-758966aff2df-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.267158 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.267090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqstb\" (UniqueName: \"kubernetes.io/projected/bb1c2cbe-5a8d-49da-b182-758966aff2df-kube-api-access-lqstb\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.367826 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.367796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.367999 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.367844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb1c2cbe-5a8d-49da-b182-758966aff2df-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.367999 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:04.367943    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 20:42:04.367999 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.367953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqstb\" (UniqueName: \"kubernetes.io/projected/bb1c2cbe-5a8d-49da-b182-758966aff2df-kube-api-access-lqstb\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.368151 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:04.368045    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert podName:bb1c2cbe-5a8d-49da-b182-758966aff2df nodeName:}" failed. No retries permitted until 2026-07-27 20:42:04.868022338 +0000 UTC m=+423.472507206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-58rcq" (UID: "bb1c2cbe-5a8d-49da-b182-758966aff2df") : secret "plugin-serving-cert" not found
Jul 27 20:42:04.368451 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.368433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb1c2cbe-5a8d-49da-b182-758966aff2df-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.378489 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.378458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqstb\" (UniqueName: \"kubernetes.io/projected/bb1c2cbe-5a8d-49da-b182-758966aff2df-kube-api-access-lqstb\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.792549 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.792513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:04.872842 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.872813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:04.875228 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:04.875200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1c2cbe-5a8d-49da-b182-758966aff2df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58rcq\" (UID: \"bb1c2cbe-5a8d-49da-b182-758966aff2df\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:05.089287 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:05.089191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"
Jul 27 20:42:05.219899 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:05.219870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq"]
Jul 27 20:42:05.222380 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:05.222351    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb1c2cbe_5a8d_49da_b182_758966aff2df.slice/crio-c2db81e1e025a82810a05a3445aedbb1af7f98f4234be8be16ee0275ef4ac7de WatchSource:0}: Error finding container c2db81e1e025a82810a05a3445aedbb1af7f98f4234be8be16ee0275ef4ac7de: Status 404 returned error can't find the container with id c2db81e1e025a82810a05a3445aedbb1af7f98f4234be8be16ee0275ef4ac7de
Jul 27 20:42:05.914483 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:05.914450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq" event={"ID":"bb1c2cbe-5a8d-49da-b182-758966aff2df","Type":"ContainerStarted","Data":"c2db81e1e025a82810a05a3445aedbb1af7f98f4234be8be16ee0275ef4ac7de"}
Jul 27 20:42:06.029321 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:06.029284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:06.135283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:06.135248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:12.901511 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:12.901478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:14.059953 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.059917    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"]
Jul 27 20:42:14.063676 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.063653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.078072 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.078048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"]
Jul 27 20:42:14.159915 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.159880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.160113 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.160044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwlqj\" (UniqueName: \"kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.261303 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.261262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwlqj\" (UniqueName: \"kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.261493 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.261326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.261765 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.261746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.271761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.271734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwlqj\" (UniqueName: \"kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.377193 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.377115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:14.526799 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.526758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"]
Jul 27 20:42:14.708767 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.708724    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"]
Jul 27 20:42:14.713039 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.713002    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"]
Jul 27 20:42:14.728376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.728340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"]
Jul 27 20:42:14.728665 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.728590    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" containerName="manager" containerID="cri-o://d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8" gracePeriod=2
Jul 27 20:42:14.731191 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.731159    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:14.738685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.738658    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.740990 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:14.740920    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:14.743015 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.742987    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"]
Jul 27 20:42:14.753539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.753513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:14.760023 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.759995    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:14.760507 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.760483    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" containerName="manager"
Jul 27 20:42:14.760672 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.760651    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" containerName="manager"
Jul 27 20:42:14.760810 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.760796    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" containerName="manager"
Jul 27 20:42:14.765809 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.765783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.780826 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:14.780735    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:14.785187 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.785156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:14.866554 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.866506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djm2v\" (UniqueName: \"kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.866736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.866578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnbj\" (UniqueName: \"kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.866736 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.866721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.866886 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.866769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.968233 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.968233 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.968459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djm2v\" (UniqueName: \"kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.968459 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnbj\" (UniqueName: \"kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.968603 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.968715 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.968669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:14.977528 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.977504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnbj\" (UniqueName: \"kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvff8\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:14.978061 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:14.978040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djm2v\" (UniqueName: \"kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm5hs\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:15.110337 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:15.110295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:15.118780 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:15.118753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:16.123614 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:16.123573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:16.219302 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:16.219271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:16.723866 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:16.723830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:16.815112 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:16.815071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:20.907665 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:20.907617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:21.008105 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:21.008069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:23.311783 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:23.311747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:23.413412 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:23.413376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:27.911997 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:27.911936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:28.015041 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.015003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:28.581713 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:28.581678    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f3e4f5_b82f_4b7e_b56d_ee8ac6b72b07.slice/crio-876ef6a98d4207827ca037b468d8a0df56d65992bd4fcf97179bd3bf6ed75cd7 WatchSource:0}: Error finding container 876ef6a98d4207827ca037b468d8a0df56d65992bd4fcf97179bd3bf6ed75cd7: Status 404 returned error can't find the container with id 876ef6a98d4207827ca037b468d8a0df56d65992bd4fcf97179bd3bf6ed75cd7
Jul 27 20:42:28.754311 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.754269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:28.755999 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:28.755947    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5184f049_859d_4262_940f_a4645c966a0e.slice/crio-9c95f1f616db9627bd135627e5eadbc69f8df09e2ca3910fe856309162cbceea WatchSource:0}: Error finding container 9c95f1f616db9627bd135627e5eadbc69f8df09e2ca3910fe856309162cbceea: Status 404 returned error can't find the container with id 9c95f1f616db9627bd135627e5eadbc69f8df09e2ca3910fe856309162cbceea
Jul 27 20:42:28.758634 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.758616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:28.760423 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:28.760395    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:28.775575 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.775551    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:28.777752 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:28.777716    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef10c0e_1438_4ad8_9a75_2179e3b0691d.slice/crio-6292c2276d73d9a3abd893ed6107cf196eff55696a13597aca8dfcfb7794ac45 WatchSource:0}: Error finding container 6292c2276d73d9a3abd893ed6107cf196eff55696a13597aca8dfcfb7794ac45: Status 404 returned error can't find the container with id 6292c2276d73d9a3abd893ed6107cf196eff55696a13597aca8dfcfb7794ac45
Jul 27 20:42:28.800702 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.800673    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume\") pod \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") "
Jul 27 20:42:28.800806 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.800766    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdvlp\" (UniqueName: \"kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp\") pod \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\" (UID: \"5d18e197-4ef4-461f-b1ab-12ec52c1e941\") "
Jul 27 20:42:28.801028 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.801007    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d18e197-4ef4-461f-b1ab-12ec52c1e941" (UID: "5d18e197-4ef4-461f-b1ab-12ec52c1e941"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:28.802544 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.802520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp" (OuterVolumeSpecName: "kube-api-access-kdvlp") pod "5d18e197-4ef4-461f-b1ab-12ec52c1e941" (UID: "5d18e197-4ef4-461f-b1ab-12ec52c1e941"). InnerVolumeSpecName "kube-api-access-kdvlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:28.902017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.901982    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d18e197-4ef4-461f-b1ab-12ec52c1e941-extensions-socket-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:28.902017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:28.902016    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdvlp\" (UniqueName: \"kubernetes.io/projected/5d18e197-4ef4-461f-b1ab-12ec52c1e941-kube-api-access-kdvlp\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:29.047223 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.047179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq" event={"ID":"bb1c2cbe-5a8d-49da-b182-758966aff2df","Type":"ContainerStarted","Data":"0ee5476f01f34d4efbc532b73456f5be3ccc65223c1aefa477a523e2a701b0fb"}
Jul 27 20:42:29.048484 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.048460    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" containerID="d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8" exitCode=0
Jul 27 20:42:29.048602 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.048494    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:29.048602 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.048524    2563 scope.go:117] "RemoveContainer" containerID="d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8"
Jul 27 20:42:29.049385 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.049349    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:29.050445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.050419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" event={"ID":"5184f049-859d-4262-940f-a4645c966a0e","Type":"ContainerStarted","Data":"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"}
Jul 27 20:42:29.050549 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.050470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" event={"ID":"5184f049-859d-4262-940f-a4645c966a0e","Type":"ContainerStarted","Data":"9c95f1f616db9627bd135627e5eadbc69f8df09e2ca3910fe856309162cbceea"}
Jul 27 20:42:29.050549 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.050515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:29.052265 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.052226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" event={"ID":"def10c0e-1438-4ad8-9a75-2179e3b0691d","Type":"ContainerStarted","Data":"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"}
Jul 27 20:42:29.052386 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.052275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" event={"ID":"def10c0e-1438-4ad8-9a75-2179e3b0691d","Type":"ContainerStarted","Data":"6292c2276d73d9a3abd893ed6107cf196eff55696a13597aca8dfcfb7794ac45"}
Jul 27 20:42:29.052386 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.052305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:29.054120 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.054098    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" containerName="manager" containerID="cri-o://bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c" gracePeriod=2
Jul 27 20:42:29.058894 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.058795    2563 scope.go:117] "RemoveContainer" containerID="d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8"
Jul 27 20:42:29.059042 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.059022    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8\": container with ID starting with d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8 not found: ID does not exist" containerID="d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8"
Jul 27 20:42:29.059096 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.059048    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8"} err="failed to get container status \"d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8\": rpc error: code = NotFound desc = could not find container \"d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8\": container with ID starting with d7d1dce21a9ad80628bb903de900a49b2d917b02b1a8073bda2ae757b8f25fd8 not found: ID does not exist"
Jul 27 20:42:29.066901 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.066861    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58rcq" podStartSLOduration=1.602229764 podStartE2EDuration="25.066844788s" totalImagesPullingTime="23.464615024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:29.065689678 +0000 UTC m=+447.670174553" watchObservedRunningTime="2026-07-27 20:42:29.066844788 +0000 UTC m=+447.671329663"
Jul 27 20:42:29.068080 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.068058    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:29.096213 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.095951    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" podStartSLOduration=15.095929904 podStartE2EDuration="15.095929904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:29.09499628 +0000 UTC m=+447.699481161" watchObservedRunningTime="2026-07-27 20:42:29.095929904 +0000 UTC m=+447.700414780"
Jul 27 20:42:29.096924 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.096896    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:29.120493 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.120428    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" podStartSLOduration=15.120413998 podStartE2EDuration="15.120413998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:29.117660736 +0000 UTC m=+447.722145611" watchObservedRunningTime="2026-07-27 20:42:29.120413998 +0000 UTC m=+447.724898873"
Jul 27 20:42:29.297352 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.297327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:29.299850 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.299824    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-trzdc\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-trzdc"
Jul 27 20:42:29.301697 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:29.301675    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:29.407337 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.407246    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume\") pod \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") "
Jul 27 20:42:29.407513 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.407340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwlqj\" (UniqueName: \"kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj\") pod \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\" (UID: \"c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07\") "
Jul 27 20:42:29.407513 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.407485    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" (UID: "c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:29.407623 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.407589    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-extensions-socket-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:29.409293 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.409272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj" (OuterVolumeSpecName: "kube-api-access-gwlqj") pod "c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" (UID: "c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07"). InnerVolumeSpecName "kube-api-access-gwlqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:29.508138 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.508106    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwlqj\" (UniqueName: \"kubernetes.io/projected/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07-kube-api-access-gwlqj\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:29.982675 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.982639    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d18e197-4ef4-461f-b1ab-12ec52c1e941" path="/var/lib/kubelet/pods/5d18e197-4ef4-461f-b1ab-12ec52c1e941/volumes"
Jul 27 20:42:29.983034 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:29.983018    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" path="/var/lib/kubelet/pods/c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07/volumes"
Jul 27 20:42:30.061021 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:30.060990    2563 generic.go:356] "Generic (PLEG): container finished" podID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" containerID="bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c" exitCode=2
Jul 27 20:42:30.061480 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:30.061034    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:30.061480 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:30.061113    2563 scope.go:117] "RemoveContainer" containerID="bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c"
Jul 27 20:42:30.063162 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:30.063115    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:30.064838 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:30.064819    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:30.069684 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:30.069668    2563 scope.go:117] "RemoveContainer" containerID="bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c"
Jul 27 20:42:30.069981 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:30.069943    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c\": container with ID starting with bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c not found: ID does not exist" containerID="bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c"
Jul 27 20:42:30.070041 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:30.069988    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c"} err="failed to get container status \"bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c\": rpc error: code = NotFound desc = could not find container \"bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c\": container with ID starting with bd466c5f436dfc3c2b048fa244ecc12e73210ecf4613c59f402e3661b3fc0d6c not found: ID does not exist"
Jul 27 20:42:31.981517 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:31.981475    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zmwcd\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zmwcd"
Jul 27 20:42:35.442270 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:35.442236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:35.542912 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:35.542875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:36.350979 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:36.350929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:36.447370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:36.447335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:40.063334 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.063304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:40.063688 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.063374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:40.133373 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.133340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:40.133551 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.133527    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" podUID="5184f049-859d-4262-940f-a4645c966a0e" containerName="manager" containerID="cri-o://dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6" gracePeriod=10
Jul 27 20:42:40.382120 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.382089    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:42:40.382444 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.382431    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" containerName="manager"
Jul 27 20:42:40.382489 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.382445    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" containerName="manager"
Jul 27 20:42:40.382534 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.382504    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f3e4f5-b82f-4b7e-b56d-ee8ac6b72b07" containerName="manager"
Jul 27 20:42:40.384844 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.384824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.386316 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.386297    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:40.397707 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.397686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:42:40.499888 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.499854    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume\") pod \"5184f049-859d-4262-940f-a4645c966a0e\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") "
Jul 27 20:42:40.500097 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.499944    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwnbj\" (UniqueName: \"kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj\") pod \"5184f049-859d-4262-940f-a4645c966a0e\" (UID: \"5184f049-859d-4262-940f-a4645c966a0e\") "
Jul 27 20:42:40.500170 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.500091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkmw\" (UniqueName: \"kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.500264 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.500240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.500373 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.500317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5184f049-859d-4262-940f-a4645c966a0e" (UID: "5184f049-859d-4262-940f-a4645c966a0e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:40.501932 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.501913    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj" (OuterVolumeSpecName: "kube-api-access-qwnbj") pod "5184f049-859d-4262-940f-a4645c966a0e" (UID: "5184f049-859d-4262-940f-a4645c966a0e"). InnerVolumeSpecName "kube-api-access-qwnbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:40.601399 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.601310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.601399 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.601363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khkmw\" (UniqueName: \"kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.601399 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.601397    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwnbj\" (UniqueName: \"kubernetes.io/projected/5184f049-859d-4262-940f-a4645c966a0e-kube-api-access-qwnbj\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:40.601631 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.601409    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5184f049-859d-4262-940f-a4645c966a0e-extensions-socket-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:40.601771 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.601750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.609494 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.609459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkmw\" (UniqueName: \"kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw\") pod \"kuadrant-operator-controller-manager-86878c769f-spzn5\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.694273 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.694231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:40.834147 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:40.834114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:42:40.838452 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:40.838418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32ad675_1248_453f_bb1d_602fc87979a6.slice/crio-36bc09bc4204e29089f6275e1a406743269e198d19fbb87473a710a9ec82b27e WatchSource:0}: Error finding container 36bc09bc4204e29089f6275e1a406743269e198d19fbb87473a710a9ec82b27e: Status 404 returned error can't find the container with id 36bc09bc4204e29089f6275e1a406743269e198d19fbb87473a710a9ec82b27e
Jul 27 20:42:41.127812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.127703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" event={"ID":"c32ad675-1248-453f-bb1d-602fc87979a6","Type":"ContainerStarted","Data":"078780fe70e38f8f0d0a128f84f2e7b95e9fe6e4fc0ca9856132c0fc56221b6f"}
Jul 27 20:42:41.127812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.127765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" event={"ID":"c32ad675-1248-453f-bb1d-602fc87979a6","Type":"ContainerStarted","Data":"36bc09bc4204e29089f6275e1a406743269e198d19fbb87473a710a9ec82b27e"}
Jul 27 20:42:41.127812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.127794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:41.129117 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.129093    2563 generic.go:356] "Generic (PLEG): container finished" podID="5184f049-859d-4262-940f-a4645c966a0e" containerID="dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6" exitCode=0
Jul 27 20:42:41.129259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.129124    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"
Jul 27 20:42:41.129259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.129141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" event={"ID":"5184f049-859d-4262-940f-a4645c966a0e","Type":"ContainerDied","Data":"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"}
Jul 27 20:42:41.129259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.129190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8" event={"ID":"5184f049-859d-4262-940f-a4645c966a0e","Type":"ContainerDied","Data":"9c95f1f616db9627bd135627e5eadbc69f8df09e2ca3910fe856309162cbceea"}
Jul 27 20:42:41.129259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.129220    2563 scope.go:117] "RemoveContainer" containerID="dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"
Jul 27 20:42:41.145333 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.145309    2563 scope.go:117] "RemoveContainer" containerID="dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"
Jul 27 20:42:41.145663 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:41.145639    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6\": container with ID starting with dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6 not found: ID does not exist" containerID="dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"
Jul 27 20:42:41.145763 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.145670    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6"} err="failed to get container status \"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6\": rpc error: code = NotFound desc = could not find container \"dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6\": container with ID starting with dd30bcca5d30a6a707720306ecc988afcb852627f1fea663a792a42ab97dbdd6 not found: ID does not exist"
Jul 27 20:42:41.149885 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.149840    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" podStartSLOduration=1.149824927 podStartE2EDuration="1.149824927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:41.147882167 +0000 UTC m=+459.752367069" watchObservedRunningTime="2026-07-27 20:42:41.149824927 +0000 UTC m=+459.754309803"
Jul 27 20:42:41.163683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.163645    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:41.167401 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.167370    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvff8"]
Jul 27 20:42:41.983146 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:41.983118    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5184f049-859d-4262-940f-a4645c966a0e" path="/var/lib/kubelet/pods/5184f049-859d-4262-940f-a4645c966a0e/volumes"
Jul 27 20:42:52.138376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.138344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:42:52.198785 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.198747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:52.199442 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.199035    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" podUID="def10c0e-1438-4ad8-9a75-2179e3b0691d" containerName="manager" containerID="cri-o://39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb" gracePeriod=10
Jul 27 20:42:52.517818 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.517783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:52.610348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.610313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djm2v\" (UniqueName: \"kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v\") pod \"def10c0e-1438-4ad8-9a75-2179e3b0691d\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") "
Jul 27 20:42:52.610539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.610404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume\") pod \"def10c0e-1438-4ad8-9a75-2179e3b0691d\" (UID: \"def10c0e-1438-4ad8-9a75-2179e3b0691d\") "
Jul 27 20:42:52.610780 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.610756    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "def10c0e-1438-4ad8-9a75-2179e3b0691d" (UID: "def10c0e-1438-4ad8-9a75-2179e3b0691d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:42:52.612493 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.612474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v" (OuterVolumeSpecName: "kube-api-access-djm2v") pod "def10c0e-1438-4ad8-9a75-2179e3b0691d" (UID: "def10c0e-1438-4ad8-9a75-2179e3b0691d"). InnerVolumeSpecName "kube-api-access-djm2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:42:52.711407 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.711314    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djm2v\" (UniqueName: \"kubernetes.io/projected/def10c0e-1438-4ad8-9a75-2179e3b0691d-kube-api-access-djm2v\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:52.711407 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:52.711350    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/def10c0e-1438-4ad8-9a75-2179e3b0691d-extensions-socket-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:42:53.192283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.192252    2563 generic.go:356] "Generic (PLEG): container finished" podID="def10c0e-1438-4ad8-9a75-2179e3b0691d" containerID="39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb" exitCode=0
Jul 27 20:42:53.192694 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.192294    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"
Jul 27 20:42:53.192694 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.192337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" event={"ID":"def10c0e-1438-4ad8-9a75-2179e3b0691d","Type":"ContainerDied","Data":"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"}
Jul 27 20:42:53.192694 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.192392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs" event={"ID":"def10c0e-1438-4ad8-9a75-2179e3b0691d","Type":"ContainerDied","Data":"6292c2276d73d9a3abd893ed6107cf196eff55696a13597aca8dfcfb7794ac45"}
Jul 27 20:42:53.192694 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.192413    2563 scope.go:117] "RemoveContainer" containerID="39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"
Jul 27 20:42:53.201905 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.201752    2563 scope.go:117] "RemoveContainer" containerID="39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"
Jul 27 20:42:53.202011 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:42:53.201993    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb\": container with ID starting with 39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb not found: ID does not exist" containerID="39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"
Jul 27 20:42:53.202057 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.202019    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb"} err="failed to get container status \"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb\": rpc error: code = NotFound desc = could not find container \"39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb\": container with ID starting with 39ece7a17de7ad40b997e00354b4332159596b09625d966dd1c68c77d0784fdb not found: ID does not exist"
Jul 27 20:42:53.214994 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.214942    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:53.219155 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.219131    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm5hs"]
Jul 27 20:42:53.982093 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:53.982062    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def10c0e-1438-4ad8-9a75-2179e3b0691d" path="/var/lib/kubelet/pods/def10c0e-1438-4ad8-9a75-2179e3b0691d/volumes"
Jul 27 20:42:56.454880 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.454837    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"]
Jul 27 20:42:56.455685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455657    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5184f049-859d-4262-940f-a4645c966a0e" containerName="manager"
Jul 27 20:42:56.455685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455683    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5184f049-859d-4262-940f-a4645c966a0e" containerName="manager"
Jul 27 20:42:56.455867 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455741    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def10c0e-1438-4ad8-9a75-2179e3b0691d" containerName="manager"
Jul 27 20:42:56.455867 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455750    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="def10c0e-1438-4ad8-9a75-2179e3b0691d" containerName="manager"
Jul 27 20:42:56.456009 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5184f049-859d-4262-940f-a4645c966a0e" containerName="manager"
Jul 27 20:42:56.456009 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.455914    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="def10c0e-1438-4ad8-9a75-2179e3b0691d" containerName="manager"
Jul 27 20:42:56.479148 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.479113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:56.760209 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.760130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:42:56.840228 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.840198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"]
Jul 27 20:42:56.840370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.840332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.842918 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.842897    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v7xcr\""
Jul 27 20:42:56.945173 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a209711-6361-438d-b88e-f60e3e7139bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a209711-6361-438d-b88e-f60e3e7139bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945346 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945537 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945537 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:56.945537 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:56.945465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qml6g\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-kube-api-access-qml6g\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.045907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.045828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.045907 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.045869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qml6g\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-kube-api-access-qml6g\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.045910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.045934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a209711-6361-438d-b88e-f60e3e7139bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.045981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a209711-6361-438d-b88e-f60e3e7139bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046156 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046490 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046490 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046565 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046678 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046746 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.046881 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.046863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a209711-6361-438d-b88e-f60e3e7139bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.048223 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.048198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a209711-6361-438d-b88e-f60e3e7139bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.048643 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.048623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a209711-6361-438d-b88e-f60e3e7139bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.053788 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.053763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.054200 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.054176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qml6g\" (UniqueName: \"kubernetes.io/projected/2a209711-6361-438d-b88e-f60e3e7139bb-kube-api-access-qml6g\") pod \"maas-default-gateway-openshift-default-78bb78ff78-l79q2\" (UID: \"2a209711-6361-438d-b88e-f60e3e7139bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.151687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.151652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:57.321988 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.321944    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"]
Jul 27 20:42:57.324131 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:42:57.324102    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a209711_6361_438d_b88e_f60e3e7139bb.slice/crio-0869397f6aaf3567b4897bcec56335819da7129e2498c6ab0addd15dc976afbf WatchSource:0}: Error finding container 0869397f6aaf3567b4897bcec56335819da7129e2498c6ab0addd15dc976afbf: Status 404 returned error can't find the container with id 0869397f6aaf3567b4897bcec56335819da7129e2498c6ab0addd15dc976afbf
Jul 27 20:42:57.326245 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.326213    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:42:57.326341 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.326291    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:42:57.326400 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:57.326335    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:42:58.220913 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:58.220876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" event={"ID":"2a209711-6361-438d-b88e-f60e3e7139bb","Type":"ContainerStarted","Data":"1f9edd7e47b86309f34a442a497dfd76dea778774b9d3e8d03aa4477e05702dd"}
Jul 27 20:42:58.221334 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:58.220938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" event={"ID":"2a209711-6361-438d-b88e-f60e3e7139bb","Type":"ContainerStarted","Data":"0869397f6aaf3567b4897bcec56335819da7129e2498c6ab0addd15dc976afbf"}
Jul 27 20:42:58.241800 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:58.241742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" podStartSLOduration=2.241723454 podStartE2EDuration="2.241723454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:42:58.239291036 +0000 UTC m=+476.843775906" watchObservedRunningTime="2026-07-27 20:42:58.241723454 +0000 UTC m=+476.846208328"
Jul 27 20:42:59.152297 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:59.152258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:59.156947 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:59.156923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:59.226622 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:59.226592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:42:59.227600 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:42:59.227576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:43:05.891259 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:05.891222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:08.127660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:08.127626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:08.226105 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:08.226072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:08.326342 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:08.326307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:08.931464 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:08.931428    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:08.967934 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:08.967901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:09.005347 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.005312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:09.005507 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.005435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:09.007842 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.007827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pdthj\""
Jul 27 20:43:09.027047 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.027017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:09.158250 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.158189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l665\" (UniqueName: \"kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665\") pod \"authorino-58cd955675-fk7tc\" (UID: \"74651d83-da9f-44b4-b572-15be3205b929\") " pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:09.161309 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.161285    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:09.164392 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.164377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:09.174143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.174106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:09.259222 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.259128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l665\" (UniqueName: \"kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665\") pod \"authorino-58cd955675-fk7tc\" (UID: \"74651d83-da9f-44b4-b572-15be3205b929\") " pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:09.259387 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.259223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l57bc\" (UniqueName: \"kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc\") pod \"authorino-75d556bd77-k62ft\" (UID: \"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1\") " pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:09.267513 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.267476    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l665\" (UniqueName: \"kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665\") pod \"authorino-58cd955675-fk7tc\" (UID: \"74651d83-da9f-44b4-b572-15be3205b929\") " pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:09.313950 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.313918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:09.360013 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.359979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l57bc\" (UniqueName: \"kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc\") pod \"authorino-75d556bd77-k62ft\" (UID: \"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1\") " pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:09.369753 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.369720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l57bc\" (UniqueName: \"kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc\") pod \"authorino-75d556bd77-k62ft\" (UID: \"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1\") " pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:09.447138 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.447108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:09.448858 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:43:09.448825    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74651d83_da9f_44b4_b572_15be3205b929.slice/crio-a87aacc6dfaf2bc18370939c69c2ccb6c3cc3c54bdab24eefb8439b4e83088c3 WatchSource:0}: Error finding container a87aacc6dfaf2bc18370939c69c2ccb6c3cc3c54bdab24eefb8439b4e83088c3: Status 404 returned error can't find the container with id a87aacc6dfaf2bc18370939c69c2ccb6c3cc3c54bdab24eefb8439b4e83088c3
Jul 27 20:43:09.479030 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.478952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:09.609630 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:09.609604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:09.614132 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:43:09.613237    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00b3f8d3_dc7d_49cf_997d_2e3f0adc29c1.slice/crio-d5aaea2df0306a991f0031ac7f26db3efdd2a63494b9c64651a821b3b9e12d3c WatchSource:0}: Error finding container d5aaea2df0306a991f0031ac7f26db3efdd2a63494b9c64651a821b3b9e12d3c: Status 404 returned error can't find the container with id d5aaea2df0306a991f0031ac7f26db3efdd2a63494b9c64651a821b3b9e12d3c
Jul 27 20:43:10.322574 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:10.322502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k62ft" event={"ID":"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1","Type":"ContainerStarted","Data":"d5aaea2df0306a991f0031ac7f26db3efdd2a63494b9c64651a821b3b9e12d3c"}
Jul 27 20:43:10.326030 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:10.325895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fk7tc" event={"ID":"74651d83-da9f-44b4-b572-15be3205b929","Type":"ContainerStarted","Data":"a87aacc6dfaf2bc18370939c69c2ccb6c3cc3c54bdab24eefb8439b4e83088c3"}
Jul 27 20:43:13.347019 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:13.346912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fk7tc" event={"ID":"74651d83-da9f-44b4-b572-15be3205b929","Type":"ContainerStarted","Data":"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"}
Jul 27 20:43:13.348424 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:13.348400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k62ft" event={"ID":"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1","Type":"ContainerStarted","Data":"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"}
Jul 27 20:43:13.360781 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:13.360733    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fk7tc" podStartSLOduration=1.899107149 podStartE2EDuration="5.360717291s" totalImagesPullingTime="3.461610142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:13.360405139 +0000 UTC m=+491.964890021" watchObservedRunningTime="2026-07-27 20:43:13.360717291 +0000 UTC m=+491.965202167"
Jul 27 20:43:13.373715 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:13.373662    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-k62ft" podStartSLOduration=1.064745219 podStartE2EDuration="4.373642935s" totalImagesPullingTime="3.308897716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:13.372828393 +0000 UTC m=+491.977313270" watchObservedRunningTime="2026-07-27 20:43:13.373642935 +0000 UTC m=+491.978127812"
Jul 27 20:43:13.394871 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:13.394838    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:15.358085 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:15.358037    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fk7tc" podUID="74651d83-da9f-44b4-b572-15be3205b929" containerName="authorino" containerID="cri-o://b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90" gracePeriod=30
Jul 27 20:43:15.607370 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:15.607339    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:15.717953 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:15.717922    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l665\" (UniqueName: \"kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665\") pod \"74651d83-da9f-44b4-b572-15be3205b929\" (UID: \"74651d83-da9f-44b4-b572-15be3205b929\") "
Jul 27 20:43:15.719981 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:15.719946    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665" (OuterVolumeSpecName: "kube-api-access-4l665") pod "74651d83-da9f-44b4-b572-15be3205b929" (UID: "74651d83-da9f-44b4-b572-15be3205b929"). InnerVolumeSpecName "kube-api-access-4l665". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:15.818786 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:15.818743    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l665\" (UniqueName: \"kubernetes.io/projected/74651d83-da9f-44b4-b572-15be3205b929-kube-api-access-4l665\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:43:16.364348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.364256    2563 generic.go:356] "Generic (PLEG): container finished" podID="74651d83-da9f-44b4-b572-15be3205b929" containerID="b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90" exitCode=0
Jul 27 20:43:16.364348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.364300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fk7tc" event={"ID":"74651d83-da9f-44b4-b572-15be3205b929","Type":"ContainerDied","Data":"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"}
Jul 27 20:43:16.364348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.364323    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fk7tc"
Jul 27 20:43:16.364348 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.364339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fk7tc" event={"ID":"74651d83-da9f-44b4-b572-15be3205b929","Type":"ContainerDied","Data":"a87aacc6dfaf2bc18370939c69c2ccb6c3cc3c54bdab24eefb8439b4e83088c3"}
Jul 27 20:43:16.364936 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.364364    2563 scope.go:117] "RemoveContainer" containerID="b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"
Jul 27 20:43:16.374406 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.374383    2563 scope.go:117] "RemoveContainer" containerID="b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"
Jul 27 20:43:16.374724 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:43:16.374699    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90\": container with ID starting with b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90 not found: ID does not exist" containerID="b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"
Jul 27 20:43:16.374840 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.374728    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90"} err="failed to get container status \"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90\": rpc error: code = NotFound desc = could not find container \"b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90\": container with ID starting with b4f76db2d35bdeb8afb1c4e44581fc96b46f58dc49cdcbac73652c4c2ec35b90 not found: ID does not exist"
Jul 27 20:43:16.381415 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.381392    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:16.383388 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:16.383369    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fk7tc"]
Jul 27 20:43:17.983503 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:17.983466    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74651d83-da9f-44b4-b572-15be3205b929" path="/var/lib/kubelet/pods/74651d83-da9f-44b4-b572-15be3205b929/volumes"
Jul 27 20:43:25.580833 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:25.580797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:25.682192 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:25.682159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:26.165617 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:26.165580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:32.018540 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:32.018504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:32.073998 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:32.073953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:37.765635 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.765601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:37.909683 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.909647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:37.991095 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.991069    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ncz5s"]
Jul 27 20:43:37.991397 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.991386    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74651d83-da9f-44b4-b572-15be3205b929" containerName="authorino"
Jul 27 20:43:37.991440 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.991399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74651d83-da9f-44b4-b572-15be3205b929" containerName="authorino"
Jul 27 20:43:37.991489 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.991480    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74651d83-da9f-44b4-b572-15be3205b929" containerName="authorino"
Jul 27 20:43:37.993762 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:37.993739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.001374 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.001019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ncz5s"]
Jul 27 20:43:38.106895 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.106797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgtk\" (UniqueName: \"kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk\") pod \"authorino-5d4b67c446-ncz5s\" (UID: \"f366a641-0f98-462d-85c5-fa0ab8f2f622\") " pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.176245 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.176206    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ncz5s"]
Jul 27 20:43:38.176476 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:43:38.176455    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hdgtk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-ncz5s" podUID="f366a641-0f98-462d-85c5-fa0ab8f2f622"
Jul 27 20:43:38.201070 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.201031    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-bgc6q"]
Jul 27 20:43:38.205141 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.205099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.207954 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.207920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 20:43:38.208456 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.208315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgtk\" (UniqueName: \"kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk\") pod \"authorino-5d4b67c446-ncz5s\" (UID: \"f366a641-0f98-462d-85c5-fa0ab8f2f622\") " pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.213589 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.213562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-bgc6q"]
Jul 27 20:43:38.217984 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.217936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgtk\" (UniqueName: \"kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk\") pod \"authorino-5d4b67c446-ncz5s\" (UID: \"f366a641-0f98-462d-85c5-fa0ab8f2f622\") " pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.234882 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.234855    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bgc6q"]
Jul 27 20:43:38.235124 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:43:38.235106    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-szgpz tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-szgpz tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-bgc6q" podUID="7a200d6f-d764-4f53-b43d-47ef11333603"
Jul 27 20:43:38.264541 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.264510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:43:38.267433 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.267413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.275275 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.275252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:43:38.309219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.309179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szgpz\" (UniqueName: \"kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.309403 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.309232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk9px\" (UniqueName: \"kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.309403 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.309314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.309403 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.309362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.410483 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.410451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szgpz\" (UniqueName: \"kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.410638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.410501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk9px\" (UniqueName: \"kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.410638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.410538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.410638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.410567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.413057 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.413029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.413057 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.413049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.417835 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.417809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk9px\" (UniqueName: \"kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px\") pod \"authorino-7b6cd959dc-7zdk8\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") " pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.418061 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.418040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szgpz\" (UniqueName: \"kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz\") pod \"authorino-76877994-bgc6q\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") " pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.480824 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.480794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.481038 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.480794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.486974 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.486940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:38.490171 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.490152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:38.578321 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.578288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:43:38.612089 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.612054    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert\") pod \"7a200d6f-d764-4f53-b43d-47ef11333603\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") "
Jul 27 20:43:38.612294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.612118    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szgpz\" (UniqueName: \"kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz\") pod \"7a200d6f-d764-4f53-b43d-47ef11333603\" (UID: \"7a200d6f-d764-4f53-b43d-47ef11333603\") "
Jul 27 20:43:38.612294 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.612237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdgtk\" (UniqueName: \"kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk\") pod \"f366a641-0f98-462d-85c5-fa0ab8f2f622\" (UID: \"f366a641-0f98-462d-85c5-fa0ab8f2f622\") "
Jul 27 20:43:38.614381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.614335    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk" (OuterVolumeSpecName: "kube-api-access-hdgtk") pod "f366a641-0f98-462d-85c5-fa0ab8f2f622" (UID: "f366a641-0f98-462d-85c5-fa0ab8f2f622"). InnerVolumeSpecName "kube-api-access-hdgtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:38.614381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.614355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a200d6f-d764-4f53-b43d-47ef11333603" (UID: "7a200d6f-d764-4f53-b43d-47ef11333603"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:43:38.614528 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.614378    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz" (OuterVolumeSpecName: "kube-api-access-szgpz") pod "7a200d6f-d764-4f53-b43d-47ef11333603" (UID: "7a200d6f-d764-4f53-b43d-47ef11333603"). InnerVolumeSpecName "kube-api-access-szgpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:38.710296 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.710220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:43:38.713420 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.713390    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdgtk\" (UniqueName: \"kubernetes.io/projected/f366a641-0f98-462d-85c5-fa0ab8f2f622-kube-api-access-hdgtk\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:43:38.713420 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.713419    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a200d6f-d764-4f53-b43d-47ef11333603-tls-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:43:38.713567 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:38.713434    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szgpz\" (UniqueName: \"kubernetes.io/projected/7a200d6f-d764-4f53-b43d-47ef11333603-kube-api-access-szgpz\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:43:38.713567 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:43:38.713440    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3449d6a2_92b4_4483_9776_7040dd5ee008.slice/crio-e8122c577eed09148ebb4c50db9ef6e21e15045d5d426cf21bec4f7739679a52 WatchSource:0}: Error finding container e8122c577eed09148ebb4c50db9ef6e21e15045d5d426cf21bec4f7739679a52: Status 404 returned error can't find the container with id e8122c577eed09148ebb4c50db9ef6e21e15045d5d426cf21bec4f7739679a52
Jul 27 20:43:39.487823 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.487792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-bgc6q"
Jul 27 20:43:39.488283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.487822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" event={"ID":"3449d6a2-92b4-4483-9776-7040dd5ee008","Type":"ContainerStarted","Data":"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"}
Jul 27 20:43:39.488283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.487866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" event={"ID":"3449d6a2-92b4-4483-9776-7040dd5ee008","Type":"ContainerStarted","Data":"e8122c577eed09148ebb4c50db9ef6e21e15045d5d426cf21bec4f7739679a52"}
Jul 27 20:43:39.488283 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.487977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ncz5s"
Jul 27 20:43:39.505286 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.505220    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" podStartSLOduration=1.184118796 podStartE2EDuration="1.505204753s" totalImagesPullingTime="321.085957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:43:39.504314367 +0000 UTC m=+518.108799245" watchObservedRunningTime="2026-07-27 20:43:39.505204753 +0000 UTC m=+518.109689641"
Jul 27 20:43:39.530581 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.530553    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ncz5s"]
Jul 27 20:43:39.543757 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.543731    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:39.543918 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.543893    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-k62ft" podUID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" containerName="authorino" containerID="cri-o://0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30" gracePeriod=30
Jul 27 20:43:39.556726 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.556699    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ncz5s"]
Jul 27 20:43:39.601927 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.601898    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-bgc6q"]
Jul 27 20:43:39.617684 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.617651    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-bgc6q"]
Jul 27 20:43:39.793349 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.793324    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:39.926537 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.926490    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l57bc\" (UniqueName: \"kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc\") pod \"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1\" (UID: \"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1\") "
Jul 27 20:43:39.928597 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.928566    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc" (OuterVolumeSpecName: "kube-api-access-l57bc") pod "00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" (UID: "00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1"). InnerVolumeSpecName "kube-api-access-l57bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:43:39.982937 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.982902    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a200d6f-d764-4f53-b43d-47ef11333603" path="/var/lib/kubelet/pods/7a200d6f-d764-4f53-b43d-47ef11333603/volumes"
Jul 27 20:43:39.983184 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:39.983172    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f366a641-0f98-462d-85c5-fa0ab8f2f622" path="/var/lib/kubelet/pods/f366a641-0f98-462d-85c5-fa0ab8f2f622/volumes"
Jul 27 20:43:40.027322 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.027246    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l57bc\" (UniqueName: \"kubernetes.io/projected/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1-kube-api-access-l57bc\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:43:40.494161 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.494124    2563 generic.go:356] "Generic (PLEG): container finished" podID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" containerID="0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30" exitCode=0
Jul 27 20:43:40.494588 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.494170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k62ft"
Jul 27 20:43:40.494588 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.494211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k62ft" event={"ID":"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1","Type":"ContainerDied","Data":"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"}
Jul 27 20:43:40.494588 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.494255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k62ft" event={"ID":"00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1","Type":"ContainerDied","Data":"d5aaea2df0306a991f0031ac7f26db3efdd2a63494b9c64651a821b3b9e12d3c"}
Jul 27 20:43:40.494588 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.494275    2563 scope.go:117] "RemoveContainer" containerID="0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"
Jul 27 20:43:40.502719 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.502700    2563 scope.go:117] "RemoveContainer" containerID="0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"
Jul 27 20:43:40.502982 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:43:40.502948    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30\": container with ID starting with 0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30 not found: ID does not exist" containerID="0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"
Jul 27 20:43:40.503052 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.502996    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30"} err="failed to get container status \"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30\": rpc error: code = NotFound desc = could not find container \"0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30\": container with ID starting with 0163318011d858b32637222a0fa9da0293f4176af8cffe13349f9c2c40472f30 not found: ID does not exist"
Jul 27 20:43:40.509685 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.509665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:40.513281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:40.513262    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k62ft"]
Jul 27 20:43:41.982765 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:41.982726    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" path="/var/lib/kubelet/pods/00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1/volumes"
Jul 27 20:43:44.097147 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:44.097113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:44.160190 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:44.160161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:44.227794 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:44.227759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:47.131905 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:47.131864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:43:47.230086 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:43:47.230050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:18.891741 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:18.891705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:19.012414 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:19.012380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:19.503660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:19.503621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:19.949602 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:19.949562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:20.125173 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.125134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:20.209716 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.209634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:20.260400 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.260360    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-85h24"]
Jul 27 20:44:20.260783 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.260766    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" containerName="authorino"
Jul 27 20:44:20.260869 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.260786    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" containerName="authorino"
Jul 27 20:44:20.260921 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.260876    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b3f8d3-dc7d-49cf-997d-2e3f0adc29c1" containerName="authorino"
Jul 27 20:44:20.265142 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.265121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.267743 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.267722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 20:44:20.267858 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.267840    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m67sj\""
Jul 27 20:44:20.275761 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.275727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-85h24"]
Jul 27 20:44:20.399117 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.399076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c03db0d-00e4-4a29-b897-41000205e49d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.399313 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.399130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zbx\" (UniqueName: \"kubernetes.io/projected/6c03db0d-00e4-4a29-b897-41000205e49d-kube-api-access-b2zbx\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.500234 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.500148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c03db0d-00e4-4a29-b897-41000205e49d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.500234 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.500200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zbx\" (UniqueName: \"kubernetes.io/projected/6c03db0d-00e4-4a29-b897-41000205e49d-kube-api-access-b2zbx\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.500833 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.500811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c03db0d-00e4-4a29-b897-41000205e49d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.508446 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.508420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zbx\" (UniqueName: \"kubernetes.io/projected/6c03db0d-00e4-4a29-b897-41000205e49d-kube-api-access-b2zbx\") pod \"payload-processing-5cc6cd444b-85h24\" (UID: \"6c03db0d-00e4-4a29-b897-41000205e49d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.576985 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.576932    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:20.742225 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:20.742197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-85h24"]
Jul 27 20:44:20.744289 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:44:20.744259    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c03db0d_00e4_4a29_b897_41000205e49d.slice/crio-22477c46dbdbaf4af5f4f8df8f51086bb14dd8e31bf1808c812dacc6d2ea4b0d WatchSource:0}: Error finding container 22477c46dbdbaf4af5f4f8df8f51086bb14dd8e31bf1808c812dacc6d2ea4b0d: Status 404 returned error can't find the container with id 22477c46dbdbaf4af5f4f8df8f51086bb14dd8e31bf1808c812dacc6d2ea4b0d
Jul 27 20:44:21.718316 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:21.718272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24" event={"ID":"6c03db0d-00e4-4a29-b897-41000205e49d","Type":"ContainerStarted","Data":"22477c46dbdbaf4af5f4f8df8f51086bb14dd8e31bf1808c812dacc6d2ea4b0d"}
Jul 27 20:44:22.726273 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:22.726241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24" event={"ID":"6c03db0d-00e4-4a29-b897-41000205e49d","Type":"ContainerStarted","Data":"644b9d45a98b0f4cd22f1510e2c7d4018595cb4b630deaac6ca75c913759d2b3"}
Jul 27 20:44:22.726631 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:22.726371    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:22.743558 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:22.743500    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24" podStartSLOduration=0.862729952 podStartE2EDuration="2.743483499s" totalImagesPullingTime="1.880753547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:22.740986392 +0000 UTC m=+561.345471261" watchObservedRunningTime="2026-07-27 20:44:22.743483499 +0000 UTC m=+561.347968375"
Jul 27 20:44:27.755751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.755667    2563 generic.go:356] "Generic (PLEG): container finished" podID="2a209711-6361-438d-b88e-f60e3e7139bb" containerID="1f9edd7e47b86309f34a442a497dfd76dea778774b9d3e8d03aa4477e05702dd" exitCode=0
Jul 27 20:44:27.755751 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.755740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" event={"ID":"2a209711-6361-438d-b88e-f60e3e7139bb","Type":"ContainerDied","Data":"1f9edd7e47b86309f34a442a497dfd76dea778774b9d3e8d03aa4477e05702dd"}
Jul 27 20:44:27.756188 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.756153    2563 scope.go:117] "RemoveContainer" containerID="1f9edd7e47b86309f34a442a497dfd76dea778774b9d3e8d03aa4477e05702dd"
Jul 27 20:44:27.757200 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.757174    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:44:27.757284 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.757270    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:44:27.757332 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:27.757318    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 20:44:28.762689 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:28.762652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" event={"ID":"2a209711-6361-438d-b88e-f60e3e7139bb","Type":"ContainerStarted","Data":"06b2918d67837c97876ef2304c4d46e63faa6194b93d29b9848bffcd71a1028b"}
Jul 27 20:44:29.152898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:29.152814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:44:29.153982 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:29.153941    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l79q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:44:29.154033 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:29.154008    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" podUID="2a209711-6361-438d-b88e-f60e3e7139bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 20:44:29.227065 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:29.227034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:44:30.152239 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:30.152204    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l79q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:44:30.152636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:30.152260    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" podUID="2a209711-6361-438d-b88e-f60e3e7139bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 20:44:30.743671 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:30.743637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:30.834312 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:30.834283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:31.152299 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:31.152210    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l79q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:44:31.152299 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:31.152270    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" podUID="2a209711-6361-438d-b88e-f60e3e7139bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 20:44:32.152717 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:32.152679    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-l79q2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 20:44:32.153145 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:32.152732    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2" podUID="2a209711-6361-438d-b88e-f60e3e7139bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 20:44:33.155680 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:33.155646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:44:33.156713 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:33.156681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-l79q2"
Jul 27 20:44:33.733378 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:33.733350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-85h24"
Jul 27 20:44:41.258582 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:41.258548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:48.464877 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:48.464841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:55.731311 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.731279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"]
Jul 27 20:44:55.734909 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.734885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.737267 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.737243    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 20:44:55.737504 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.737480    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 20:44:55.738239 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.738212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vz7np\""
Jul 27 20:44:55.738352 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.738285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 20:44:55.744219 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.744199    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"]
Jul 27 20:44:55.766885 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.766863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:44:55.821940 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.821909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.822152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.821947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9kx8\" (UniqueName: \"kubernetes.io/projected/1e8c989e-33c5-4943-824b-0c69d94dccc5-kube-api-access-h9kx8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.822152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.822066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.822152 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.822104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8c989e-33c5-4943-824b-0c69d94dccc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.822309 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.822190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.822309 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.822232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.922773 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.922742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.922996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.922781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.922996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.922890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.922996 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.922928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9kx8\" (UniqueName: \"kubernetes.io/projected/1e8c989e-33c5-4943-824b-0c69d94dccc5-kube-api-access-h9kx8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.923168 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.923018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.923168 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.923045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8c989e-33c5-4943-824b-0c69d94dccc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.923269 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.923181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.923269 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.923222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.923269 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.923245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.925208 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.925185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e8c989e-33c5-4943-824b-0c69d94dccc5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.925917 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.925898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8c989e-33c5-4943-824b-0c69d94dccc5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:55.937690 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:55.937660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9kx8\" (UniqueName: \"kubernetes.io/projected/1e8c989e-33c5-4943-824b-0c69d94dccc5-kube-api-access-h9kx8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cwchk\" (UID: \"1e8c989e-33c5-4943-824b-0c69d94dccc5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:56.049879 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:56.049807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:44:56.386608 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:56.386516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"]
Jul 27 20:44:56.389439 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:44:56.389412    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8c989e_33c5_4943_824b_0c69d94dccc5.slice/crio-feef39e80154e0d37ce4e9024fd5495e7227ff1840602564a8dcf8ee3c4485b6 WatchSource:0}: Error finding container feef39e80154e0d37ce4e9024fd5495e7227ff1840602564a8dcf8ee3c4485b6: Status 404 returned error can't find the container with id feef39e80154e0d37ce4e9024fd5495e7227ff1840602564a8dcf8ee3c4485b6
Jul 27 20:44:56.935177 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:56.935136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk" event={"ID":"1e8c989e-33c5-4943-824b-0c69d94dccc5","Type":"ContainerStarted","Data":"feef39e80154e0d37ce4e9024fd5495e7227ff1840602564a8dcf8ee3c4485b6"}
Jul 27 20:44:57.941766 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:57.941732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk" event={"ID":"1e8c989e-33c5-4943-824b-0c69d94dccc5","Type":"ContainerStarted","Data":"210dc27082f236613125ce3627a395c7c455f51629ede5a84608021209fe8db0"}
Jul 27 20:44:57.965755 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:44:57.962062    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk" podStartSLOduration=1.9505653779999998 podStartE2EDuration="2.962041872s" totalImagesPullingTime="1.011476494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:44:57.957723656 +0000 UTC m=+596.562208533" watchObservedRunningTime="2026-07-27 20:44:57.962041872 +0000 UTC m=+596.566526748"
Jul 27 20:45:06.050916 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:06.050877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:45:06.051388 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:06.050945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:45:06.063913 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:06.063888    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:45:06.999200 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:06.999167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cwchk"
Jul 27 20:45:16.164496 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:16.164461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:21.275722 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:21.275687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:21.377074 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:21.377043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:22.265376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:22.265342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:26.599411 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:26.599320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:38.423465 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.423429    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"]
Jul 27 20:45:38.427745 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.427721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.430261 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.430238    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 20:45:38.435133 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.435110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"]
Jul 27 20:45:38.456375 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.456331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:45:38.500488 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gxm\" (UniqueName: \"kubernetes.io/projected/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-kube-api-access-c6gxm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.500655 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.500655 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.500655 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.500655 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.500806 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.500709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601482 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601648 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601648 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601648 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.601817 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gxm\" (UniqueName: \"kubernetes.io/projected/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-kube-api-access-c6gxm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.602103 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.601911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.602103 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.602052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.602295 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.602142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.603924 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.603897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.604120 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.604102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.609142 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.609121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gxm\" (UniqueName: \"kubernetes.io/projected/dd1a49f1-4d20-40dd-af8b-1d0a5e55b222-kube-api-access-c6gxm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6\" (UID: \"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.740539 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.740447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:38.872797 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.872769    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"]
Jul 27 20:45:38.875391 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:45:38.875353    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd1a49f1_4d20_40dd_af8b_1d0a5e55b222.slice/crio-0e8e0e086fc5972cb9263b422a7b80c2ab190023574ee35a990347e573259884 WatchSource:0}: Error finding container 0e8e0e086fc5972cb9263b422a7b80c2ab190023574ee35a990347e573259884: Status 404 returned error can't find the container with id 0e8e0e086fc5972cb9263b422a7b80c2ab190023574ee35a990347e573259884
Jul 27 20:45:38.876942 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:38.876924    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:45:39.159131 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:39.159095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6" event={"ID":"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222","Type":"ContainerStarted","Data":"c63996a9daf8a3cc2ea7bc5e5bc1b22094eb009f078b49a537e73a01ad437f33"}
Jul 27 20:45:39.159273 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:39.159146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6" event={"ID":"dd1a49f1-4d20-40dd-af8b-1d0a5e55b222","Type":"ContainerStarted","Data":"0e8e0e086fc5972cb9263b422a7b80c2ab190023574ee35a990347e573259884"}
Jul 27 20:45:39.178617 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:39.178567    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6" podStartSLOduration=0.984570035 podStartE2EDuration="1.178552355s" totalImagesPullingTime="193.98232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:45:39.174933424 +0000 UTC m=+637.779418302" watchObservedRunningTime="2026-07-27 20:45:39.178552355 +0000 UTC m=+637.783037249"
Jul 27 20:45:48.741017 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:48.740978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:48.741520 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:48.741035    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:48.753861 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:48.753836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:45:49.228120 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:45:49.228092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6"
Jul 27 20:46:33.717703 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.717669    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cb9cb66f8-4nqtz"]
Jul 27 20:46:33.721099 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.721082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.728481 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.728252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb9cb66f8-4nqtz"]
Jul 27 20:46:33.790729 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.790686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bncn9\" (UniqueName: \"kubernetes.io/projected/f70fb6f5-b982-4958-9a15-1befb3d87964-kube-api-access-bncn9\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.790729 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.790724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f70fb6f5-b982-4958-9a15-1befb3d87964-tls-cert\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.891579 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.891542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bncn9\" (UniqueName: \"kubernetes.io/projected/f70fb6f5-b982-4958-9a15-1befb3d87964-kube-api-access-bncn9\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.891579 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.891583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f70fb6f5-b982-4958-9a15-1befb3d87964-tls-cert\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.894058 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.894037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f70fb6f5-b982-4958-9a15-1befb3d87964-tls-cert\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:33.899290 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:33.899271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bncn9\" (UniqueName: \"kubernetes.io/projected/f70fb6f5-b982-4958-9a15-1befb3d87964-kube-api-access-bncn9\") pod \"authorino-5cb9cb66f8-4nqtz\" (UID: \"f70fb6f5-b982-4958-9a15-1befb3d87964\") " pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:34.031715 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:34.031631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz"
Jul 27 20:46:34.140367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:34.140327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:34.166457 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:34.166432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb9cb66f8-4nqtz"]
Jul 27 20:46:34.168641 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:46:34.168615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf70fb6f5_b982_4958_9a15_1befb3d87964.slice/crio-50fadd37b45bd572e143e97720dd1413112d3559b3da810074934c423d2d767c WatchSource:0}: Error finding container 50fadd37b45bd572e143e97720dd1413112d3559b3da810074934c423d2d767c: Status 404 returned error can't find the container with id 50fadd37b45bd572e143e97720dd1413112d3559b3da810074934c423d2d767c
Jul 27 20:46:34.245025 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:34.244978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:34.464143 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:34.464111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz" event={"ID":"f70fb6f5-b982-4958-9a15-1befb3d87964","Type":"ContainerStarted","Data":"50fadd37b45bd572e143e97720dd1413112d3559b3da810074934c423d2d767c"}
Jul 27 20:46:35.266285 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.266251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:35.363445 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.363403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:46:35.475702 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.475663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz" event={"ID":"f70fb6f5-b982-4958-9a15-1befb3d87964","Type":"ContainerStarted","Data":"7b03880fb929ac66e20625808e1b53606abf992e7d1911ed19e0198be34af130"}
Jul 27 20:46:35.493649 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.493577    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cb9cb66f8-4nqtz" podStartSLOduration=2.047446824 podStartE2EDuration="2.493553449s" totalImagesPullingTime="446.106625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:46:35.492232306 +0000 UTC m=+694.096717183" watchObservedRunningTime="2026-07-27 20:46:35.493553449 +0000 UTC m=+694.098038325"
Jul 27 20:46:35.531682 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.531151    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:46:35.531682 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.531343    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" podUID="3449d6a2-92b4-4483-9776-7040dd5ee008" containerName="authorino" containerID="cri-o://1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3" gracePeriod=30
Jul 27 20:46:35.789988 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.789912    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:46:35.912985 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.912918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk9px\" (UniqueName: \"kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px\") pod \"3449d6a2-92b4-4483-9776-7040dd5ee008\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") "
Jul 27 20:46:35.913157 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.913103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert\") pod \"3449d6a2-92b4-4483-9776-7040dd5ee008\" (UID: \"3449d6a2-92b4-4483-9776-7040dd5ee008\") "
Jul 27 20:46:35.915636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.915596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px" (OuterVolumeSpecName: "kube-api-access-zk9px") pod "3449d6a2-92b4-4483-9776-7040dd5ee008" (UID: "3449d6a2-92b4-4483-9776-7040dd5ee008"). InnerVolumeSpecName "kube-api-access-zk9px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:46:35.923550 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:35.923521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3449d6a2-92b4-4483-9776-7040dd5ee008" (UID: "3449d6a2-92b4-4483-9776-7040dd5ee008"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:46:36.014315 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.014283    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3449d6a2-92b4-4483-9776-7040dd5ee008-tls-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:46:36.014315 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.014308    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk9px\" (UniqueName: \"kubernetes.io/projected/3449d6a2-92b4-4483-9776-7040dd5ee008-kube-api-access-zk9px\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:46:36.483340 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.483306    2563 generic.go:356] "Generic (PLEG): container finished" podID="3449d6a2-92b4-4483-9776-7040dd5ee008" containerID="1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3" exitCode=0
Jul 27 20:46:36.483837 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.483356    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8"
Jul 27 20:46:36.483837 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.483398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" event={"ID":"3449d6a2-92b4-4483-9776-7040dd5ee008","Type":"ContainerDied","Data":"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"}
Jul 27 20:46:36.483837 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.483450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b6cd959dc-7zdk8" event={"ID":"3449d6a2-92b4-4483-9776-7040dd5ee008","Type":"ContainerDied","Data":"e8122c577eed09148ebb4c50db9ef6e21e15045d5d426cf21bec4f7739679a52"}
Jul 27 20:46:36.483837 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.483472    2563 scope.go:117] "RemoveContainer" containerID="1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"
Jul 27 20:46:36.493533 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.493509    2563 scope.go:117] "RemoveContainer" containerID="1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"
Jul 27 20:46:36.493802 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:46:36.493782    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3\": container with ID starting with 1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3 not found: ID does not exist" containerID="1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"
Jul 27 20:46:36.493898 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.493811    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3"} err="failed to get container status \"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3\": rpc error: code = NotFound desc = could not find container \"1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3\": container with ID starting with 1af17b1cbccf99d3f60450bb4ac8316bb54f4c277bbb605416851c314e5f4be3 not found: ID does not exist"
Jul 27 20:46:36.498876 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.498854    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:46:36.504799 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:36.504776    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b6cd959dc-7zdk8"]
Jul 27 20:46:37.984069 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:46:37.984038    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3449d6a2-92b4-4483-9776-7040dd5ee008" path="/var/lib/kubelet/pods/3449d6a2-92b4-4483-9776-7040dd5ee008/volumes"
Jul 27 20:47:20.779400 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:47:20.779345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:47:32.986358 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:47:32.986319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:47:51.951381 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:47:51.951341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:48:24.954225 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:48:24.954147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:48:25.004983 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:48:25.004935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:48:40.377182 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:48:40.377148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:48:41.638911 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:48:41.638880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:22.238838 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:22.238802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:22.337353 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:22.337321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:22.456150 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:22.456122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:28.318016 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:28.317957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:28.422460 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:28.422421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:28.515706 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:28.515672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:28.688841 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:28.688800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:34.253988 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:34.253940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:49:34.351889 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:49:34.351843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:48.659149 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:51:48.659113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:51:56.492808 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:51:56.492772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:53:26.752151 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:26.752068    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:53:26.752638 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:26.752283    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" podUID="c32ad675-1248-453f-bb1d-602fc87979a6" containerName="manager" containerID="cri-o://078780fe70e38f8f0d0a128f84f2e7b95e9fe6e4fc0ca9856132c0fc56221b6f" gracePeriod=10
Jul 27 20:53:29.650365 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:29.650284    2563 generic.go:356] "Generic (PLEG): container finished" podID="c32ad675-1248-453f-bb1d-602fc87979a6" containerID="078780fe70e38f8f0d0a128f84f2e7b95e9fe6e4fc0ca9856132c0fc56221b6f" exitCode=0
Jul 27 20:53:29.650365 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:29.650352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" event={"ID":"c32ad675-1248-453f-bb1d-602fc87979a6","Type":"ContainerDied","Data":"078780fe70e38f8f0d0a128f84f2e7b95e9fe6e4fc0ca9856132c0fc56221b6f"}
Jul 27 20:53:30.001815 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.001788    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:53:30.117728 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.117699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume\") pod \"c32ad675-1248-453f-bb1d-602fc87979a6\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") "
Jul 27 20:53:30.117887 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.117815    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khkmw\" (UniqueName: \"kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw\") pod \"c32ad675-1248-453f-bb1d-602fc87979a6\" (UID: \"c32ad675-1248-453f-bb1d-602fc87979a6\") "
Jul 27 20:53:30.118097 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.118065    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c32ad675-1248-453f-bb1d-602fc87979a6" (UID: "c32ad675-1248-453f-bb1d-602fc87979a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:53:30.118504 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.118484    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c32ad675-1248-453f-bb1d-602fc87979a6-extensions-socket-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:53:30.119890 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.119869    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw" (OuterVolumeSpecName: "kube-api-access-khkmw") pod "c32ad675-1248-453f-bb1d-602fc87979a6" (UID: "c32ad675-1248-453f-bb1d-602fc87979a6"). InnerVolumeSpecName "kube-api-access-khkmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:30.218995 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.218906    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khkmw\" (UniqueName: \"kubernetes.io/projected/c32ad675-1248-453f-bb1d-602fc87979a6-kube-api-access-khkmw\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:53:30.657372 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.657295    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"
Jul 27 20:53:30.657372 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.657336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5" event={"ID":"c32ad675-1248-453f-bb1d-602fc87979a6","Type":"ContainerDied","Data":"36bc09bc4204e29089f6275e1a406743269e198d19fbb87473a710a9ec82b27e"}
Jul 27 20:53:30.657871 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.657394    2563 scope.go:117] "RemoveContainer" containerID="078780fe70e38f8f0d0a128f84f2e7b95e9fe6e4fc0ca9856132c0fc56221b6f"
Jul 27 20:53:30.684276 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.684251    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:53:30.690380 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:30.690358    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-spzn5"]
Jul 27 20:53:31.982297 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:53:31.982265    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c32ad675-1248-453f-bb1d-602fc87979a6" path="/var/lib/kubelet/pods/c32ad675-1248-453f-bb1d-602fc87979a6/volumes"
Jul 27 20:54:04.320562 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:04.320524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:54:27.903811 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.903778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"]
Jul 27 20:54:27.904204 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904187    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3449d6a2-92b4-4483-9776-7040dd5ee008" containerName="authorino"
Jul 27 20:54:27.904204 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3449d6a2-92b4-4483-9776-7040dd5ee008" containerName="authorino"
Jul 27 20:54:27.904281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904210    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c32ad675-1248-453f-bb1d-602fc87979a6" containerName="manager"
Jul 27 20:54:27.904281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904216    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c32ad675-1248-453f-bb1d-602fc87979a6" containerName="manager"
Jul 27 20:54:27.904281 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904275    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3449d6a2-92b4-4483-9776-7040dd5ee008" containerName="authorino"
Jul 27 20:54:27.904372 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.904286    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c32ad675-1248-453f-bb1d-602fc87979a6" containerName="manager"
Jul 27 20:54:27.908362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.908345    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:27.910836 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.910820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z8smn\""
Jul 27 20:54:27.920261 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:27.920240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"]
Jul 27 20:54:28.013585 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.013548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82af687e-f274-4392-8392-756b5fa7662f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.013754 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.013591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwf9j\" (UniqueName: \"kubernetes.io/projected/82af687e-f274-4392-8392-756b5fa7662f-kube-api-access-cwf9j\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.114362 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.114335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82af687e-f274-4392-8392-756b5fa7662f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.114498 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.114374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwf9j\" (UniqueName: \"kubernetes.io/projected/82af687e-f274-4392-8392-756b5fa7662f-kube-api-access-cwf9j\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.114688 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.114670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82af687e-f274-4392-8392-756b5fa7662f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.123809 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.123785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwf9j\" (UniqueName: \"kubernetes.io/projected/82af687e-f274-4392-8392-756b5fa7662f-kube-api-access-cwf9j\") pod \"kuadrant-operator-controller-manager-86878c769f-7mpt7\" (UID: \"82af687e-f274-4392-8392-756b5fa7662f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.218938 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.218913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.377580 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.369033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"]
Jul 27 20:54:28.377580 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:54:28.371208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82af687e_f274_4392_8392_756b5fa7662f.slice/crio-235253c7dc53c852309c34bf8fb4105344298d7b39112d32a23cf32aca6a687c WatchSource:0}: Error finding container 235253c7dc53c852309c34bf8fb4105344298d7b39112d32a23cf32aca6a687c: Status 404 returned error can't find the container with id 235253c7dc53c852309c34bf8fb4105344298d7b39112d32a23cf32aca6a687c
Jul 27 20:54:28.961308 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.961274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7" event={"ID":"82af687e-f274-4392-8392-756b5fa7662f","Type":"ContainerStarted","Data":"078e14d531385756e3109b7acce5b0c1152064c3d1ad702035e44ed456af21b6"}
Jul 27 20:54:28.961687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.961329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7" event={"ID":"82af687e-f274-4392-8392-756b5fa7662f","Type":"ContainerStarted","Data":"235253c7dc53c852309c34bf8fb4105344298d7b39112d32a23cf32aca6a687c"}
Jul 27 20:54:28.961687 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.961351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:54:28.983476 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:28.983426    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7" podStartSLOduration=1.983406292 podStartE2EDuration="1.983406292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:28.982014918 +0000 UTC m=+1167.586499794" watchObservedRunningTime="2026-07-27 20:54:28.983406292 +0000 UTC m=+1167.587891172"
Jul 27 20:54:39.969209 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:54:39.969175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mpt7"
Jul 27 20:57:09.859419 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:09.859385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:37.241267 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.241184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:57:37.247247 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.247223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.249636 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.249610    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-bf44ac6e-kserve-self-signed-certs\""
Jul 27 20:57:37.251613 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.251587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:57:37.276734 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.276713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:57:37.361205 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.361324 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rql\" (UniqueName: \"kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.361367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.361367 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.361438 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.361438 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.361424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462155 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462329 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462329 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462329 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462513 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462513 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rql\" (UniqueName: \"kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462668 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462722 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462689    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.462826 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.462808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.464351 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.464332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.464631 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.464615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.470038 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.470022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rql\" (UniqueName: \"kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql\") pod \"e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") " pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.558434 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.558344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:37.689660 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.689634    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:57:37.691679 ip-10-0-140-195 kubenswrapper[2563]: W0727 20:57:37.691652    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19f81ac1_ce49_4c03_b691_10913a5ad195.slice/crio-9d6e98b604b8a4e9cf276481323e071b77bcdee903479a3a203d344c1acc9d63 WatchSource:0}: Error finding container 9d6e98b604b8a4e9cf276481323e071b77bcdee903479a3a203d344c1acc9d63: Status 404 returned error can't find the container with id 9d6e98b604b8a4e9cf276481323e071b77bcdee903479a3a203d344c1acc9d63
Jul 27 20:57:37.990470 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.990441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" event={"ID":"19f81ac1-ce49-4c03-b691-10913a5ad195","Type":"ContainerStarted","Data":"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"}
Jul 27 20:57:37.990470 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:37.990472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" event={"ID":"19f81ac1-ce49-4c03-b691-10913a5ad195","Type":"ContainerStarted","Data":"9d6e98b604b8a4e9cf276481323e071b77bcdee903479a3a203d344c1acc9d63"}
Jul 27 20:57:38.007668 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:38.007618    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" podStartSLOduration=1.007602779 podStartE2EDuration="1.007602779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:38.006390923 +0000 UTC m=+1356.610875799" watchObservedRunningTime="2026-07-27 20:57:38.007602779 +0000 UTC m=+1356.612087653"
Jul 27 20:57:47.558614 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:47.558585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:47.559113 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:47.558852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:47.571664 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:47.571642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:48.053335 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:48.053303    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:57:57.771563 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:57:57.771514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:01.892578 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:01.892546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:03.471066 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:03.471033    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:58:03.494257 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:03.494210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 20:58:18.492342 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.492300    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" podUID="19f81ac1-ce49-4c03-b691-10913a5ad195" containerName="main" containerID="cri-o://3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e" gracePeriod=45
Jul 27 20:58:18.740000 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.739951    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:58:18.815241 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815173    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rql\" (UniqueName: \"kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815241 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815243    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815408 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815374    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs\") pod \"19f81ac1-ce49-4c03-b691-10913a5ad195\" (UID: \"19f81ac1-ce49-4c03-b691-10913a5ad195\") "
Jul 27 20:58:18.815656 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:18.815656 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815515    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache" (OuterVolumeSpecName: "model-cache") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:18.815656 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home" (OuterVolumeSpecName: "home") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:18.815812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815674    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-tmp-dir\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:18.815812 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.815689    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-model-cache\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:18.817424 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.817396    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm" (OuterVolumeSpecName: "dshm") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:18.817532 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.817405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql" (OuterVolumeSpecName: "kube-api-access-59rql") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "kube-api-access-59rql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:18.817532 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.817434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19f81ac1-ce49-4c03-b691-10913a5ad195" (UID: "19f81ac1-ce49-4c03-b691-10913a5ad195"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:58:18.916376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.916341    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-home\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:18.916376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.916368    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19f81ac1-ce49-4c03-b691-10913a5ad195-dshm\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:18.916376 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.916376    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19f81ac1-ce49-4c03-b691-10913a5ad195-tls-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:18.916604 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:18.916386    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rql\" (UniqueName: \"kubernetes.io/projected/19f81ac1-ce49-4c03-b691-10913a5ad195-kube-api-access-59rql\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 20:58:19.207939 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.207908    2563 generic.go:356] "Generic (PLEG): container finished" podID="19f81ac1-ce49-4c03-b691-10913a5ad195" containerID="3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e" exitCode=0
Jul 27 20:58:19.208111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.207949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"
Jul 27 20:58:19.208111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.208004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" event={"ID":"19f81ac1-ce49-4c03-b691-10913a5ad195","Type":"ContainerDied","Data":"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"}
Jul 27 20:58:19.208111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.208054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9" event={"ID":"19f81ac1-ce49-4c03-b691-10913a5ad195","Type":"ContainerDied","Data":"9d6e98b604b8a4e9cf276481323e071b77bcdee903479a3a203d344c1acc9d63"}
Jul 27 20:58:19.208111 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.208073    2563 scope.go:117] "RemoveContainer" containerID="3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"
Jul 27 20:58:19.218151 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.218135    2563 scope.go:117] "RemoveContainer" containerID="3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"
Jul 27 20:58:19.218431 ip-10-0-140-195 kubenswrapper[2563]: E0727 20:58:19.218407    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e\": container with ID starting with 3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e not found: ID does not exist" containerID="3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"
Jul 27 20:58:19.218525 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.218445    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e"} err="failed to get container status \"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e\": rpc error: code = NotFound desc = could not find container \"3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e\": container with ID starting with 3f8786b3656513fde2a8b9c1b2deaca6c015455beb48687c62549c10358a9e5e not found: ID does not exist"
Jul 27 20:58:19.229287 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.229262    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:58:19.238585 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.233854    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-bf44ac6e-kserve-754bc67dc9-vk9h9"]
Jul 27 20:58:19.983234 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:19.983197    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f81ac1-ce49-4c03-b691-10913a5ad195" path="/var/lib/kubelet/pods/19f81ac1-ce49-4c03-b691-10913a5ad195/volumes"
Jul 27 20:58:35.726044 ip-10-0-140-195 kubenswrapper[2563]: I0727 20:58:35.726013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:06.327294 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:06.327252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:06.416215 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:06.416179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:11.295832 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:11.295788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:32.732907 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:32.732871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:35.781667 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:35.781629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:35.880028 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:35.879982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:36.213026 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:36.212990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:38.818660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:38.818618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:38.917195 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:38.917163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:42.161413 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.161379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:42.229030 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.228994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:42.394086 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.394053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:42.666547 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.666514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:01:42.666894 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.666881    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f81ac1-ce49-4c03-b691-10913a5ad195" containerName="main"
Jul 27 21:01:42.666973 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.666896    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f81ac1-ce49-4c03-b691-10913a5ad195" containerName="main"
Jul 27 21:01:42.667041 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.667021    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f81ac1-ce49-4c03-b691-10913a5ad195" containerName="main"
Jul 27 21:01:42.670148 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.670131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.672769 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.672744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dcdeec0f-openshift-default-dockercfg-xzhh8\""
Jul 27 21:01:42.694671 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.694644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:01:42.696751 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.696725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:42.835855 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.835819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6q4m\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.835866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.835910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.835931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.835988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.836009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836037 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.836034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.836095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.836246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.836121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6q4m\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.937988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.937978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.938350 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.938328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.939784 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.939762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.939886 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.939872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.946362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.946338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.946447 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.946341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6q4m\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m\") pod \"e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") " pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.980710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.980666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:42.996694 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:42.996661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:43.118650 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.118512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:01:43.121411 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:01:43.121382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4a1bd6_5e2b_4ed4_90f9_9b14a8add6b1.slice/crio-1d0d788e0cc62ad1aba7951242289aa0174999cd0ef0c609eae5097aad1e12e3 WatchSource:0}: Error finding container 1d0d788e0cc62ad1aba7951242289aa0174999cd0ef0c609eae5097aad1e12e3: Status 404 returned error can't find the container with id 1d0d788e0cc62ad1aba7951242289aa0174999cd0ef0c609eae5097aad1e12e3
Jul 27 21:01:43.123494 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.123464    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:43.123573 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.123535    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:43.123573 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.123564    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:43.294159 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.294068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerStarted","Data":"1a754e4baadb205ee62e86be2153fb3792bc15eff129f818d76a57765bbf5240"}
Jul 27 21:01:43.294159 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.294121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerStarted","Data":"1d0d788e0cc62ad1aba7951242289aa0174999cd0ef0c609eae5097aad1e12e3"}
Jul 27 21:01:43.313986 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.313921    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podStartSLOduration=1.3139024 podStartE2EDuration="1.3139024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:43.312144623 +0000 UTC m=+1601.916629499" watchObservedRunningTime="2026-07-27 21:01:43.3139024 +0000 UTC m=+1601.918387279"
Jul 27 21:01:43.983524 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:43.983492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:44.650592 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:44.650560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:44.788202 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:44.788170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:44.887346 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:44.887317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:44.986425 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:44.986396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:44.994806 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:44.994776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:45.304697 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.304622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:45.305473 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.305455    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:45.490283 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.490252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:45.579119 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.579037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:01:45.625485 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.625446    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:01:45.629017 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.628993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.631561 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.631540    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-dcdeec0f\""
Jul 27 21:01:45.631687 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.631613    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-dcdeec0f-dockercfg-8t82q\""
Jul 27 21:01:45.638251 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.638229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:01:45.762235 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.762202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866v7\" (UniqueName: \"kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.762635 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.762242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.863666 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.863583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-866v7\" (UniqueName: \"kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.863666 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.863629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.864372 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.864352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.886294 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.886267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-866v7\" (UniqueName: \"kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7\") pod \"payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") " pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:45.941246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:45.941206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:46.089473 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:46.089449    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:01:46.092820 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:01:46.092786    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcc8e5f_36fc_4490_86db_1aca2686236b.slice/crio-825b571d80b60d40f1bb3eea4973880fc2abd248bd432dae2b3ee77bd1a98aa7 WatchSource:0}: Error finding container 825b571d80b60d40f1bb3eea4973880fc2abd248bd432dae2b3ee77bd1a98aa7: Status 404 returned error can't find the container with id 825b571d80b60d40f1bb3eea4973880fc2abd248bd432dae2b3ee77bd1a98aa7
Jul 27 21:01:46.311473 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:46.311439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" event={"ID":"bdcc8e5f-36fc-4490-86db-1aca2686236b","Type":"ContainerStarted","Data":"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"}
Jul 27 21:01:46.311723 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:46.311707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" event={"ID":"bdcc8e5f-36fc-4490-86db-1aca2686236b","Type":"ContainerStarted","Data":"825b571d80b60d40f1bb3eea4973880fc2abd248bd432dae2b3ee77bd1a98aa7"}
Jul 27 21:01:46.311841 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:46.311821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:46.329300 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:46.329256    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" podStartSLOduration=1.329228302 podStartE2EDuration="1.329228302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:46.327511782 +0000 UTC m=+1604.931996658" watchObservedRunningTime="2026-07-27 21:01:46.329228302 +0000 UTC m=+1604.933713177"
Jul 27 21:01:56.366529 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.366417    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerID="1a754e4baadb205ee62e86be2153fb3792bc15eff129f818d76a57765bbf5240" exitCode=0
Jul 27 21:01:56.366529 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.366494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerDied","Data":"1a754e4baadb205ee62e86be2153fb3792bc15eff129f818d76a57765bbf5240"}
Jul 27 21:01:56.367125 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.366995    2563 scope.go:117] "RemoveContainer" containerID="1a754e4baadb205ee62e86be2153fb3792bc15eff129f818d76a57765bbf5240"
Jul 27 21:01:56.368001 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.367956    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:56.368071 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.368043    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:56.368109 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:56.368071    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:01:57.320019 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:57.319987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:01:57.389902 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:57.389869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerStarted","Data":"f6f453ab4bcf0f13242920060162a19b472893daea5edb5a5f460dbe539c0f9b"}
Jul 27 21:01:57.985838 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:57.985794    2563 patch_prober.go:28] interesting pod/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:01:57.986146 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:57.986116    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 21:01:57.987420 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:57.987391    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:01:58.982094 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:58.982055    2563 patch_prober.go:28] interesting pod/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:01:58.982600 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:58.982120    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 21:01:59.984498 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:59.984455    2563 patch_prober.go:28] interesting pod/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:01:59.984985 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:01:59.984521    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 21:02:00.305449 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:00.305354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:02:00.982210 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:00.982163    2563 patch_prober.go:28] interesting pod/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 27 21:02:00.982452 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:00.982235    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 27 21:02:01.985594 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:01.985566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:02:01.986672 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:01.986655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:02:20.906725 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:20.906689    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:02:20.907291 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:20.906943    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" podUID="bdcc8e5f-36fc-4490-86db-1aca2686236b" containerName="payload-processing" containerID="cri-o://d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb" gracePeriod=30
Jul 27 21:02:20.931768 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:20.926937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:21.160722 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.160700    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:02:21.309548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.309520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-866v7\" (UniqueName: \"kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7\") pod \"bdcc8e5f-36fc-4490-86db-1aca2686236b\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") "
Jul 27 21:02:21.309729 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.309584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume\") pod \"bdcc8e5f-36fc-4490-86db-1aca2686236b\" (UID: \"bdcc8e5f-36fc-4490-86db-1aca2686236b\") "
Jul 27 21:02:21.309985 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.309941    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bdcc8e5f-36fc-4490-86db-1aca2686236b" (UID: "bdcc8e5f-36fc-4490-86db-1aca2686236b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:21.311822 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.311799    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7" (OuterVolumeSpecName: "kube-api-access-866v7") pod "bdcc8e5f-36fc-4490-86db-1aca2686236b" (UID: "bdcc8e5f-36fc-4490-86db-1aca2686236b"). InnerVolumeSpecName "kube-api-access-866v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:21.410430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.410402    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bdcc8e5f-36fc-4490-86db-1aca2686236b-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.410430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.410429    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-866v7\" (UniqueName: \"kubernetes.io/projected/bdcc8e5f-36fc-4490-86db-1aca2686236b-kube-api-access-866v7\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:21.523180 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.523099    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdcc8e5f-36fc-4490-86db-1aca2686236b" containerID="d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb" exitCode=0
Jul 27 21:02:21.523180 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.523142    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"
Jul 27 21:02:21.523360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.523181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" event={"ID":"bdcc8e5f-36fc-4490-86db-1aca2686236b","Type":"ContainerDied","Data":"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"}
Jul 27 21:02:21.523360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.523245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt" event={"ID":"bdcc8e5f-36fc-4490-86db-1aca2686236b","Type":"ContainerDied","Data":"825b571d80b60d40f1bb3eea4973880fc2abd248bd432dae2b3ee77bd1a98aa7"}
Jul 27 21:02:21.523360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.523266    2563 scope.go:117] "RemoveContainer" containerID="d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"
Jul 27 21:02:21.532917 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.532900    2563 scope.go:117] "RemoveContainer" containerID="d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"
Jul 27 21:02:21.533193 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:02:21.533173    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb\": container with ID starting with d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb not found: ID does not exist" containerID="d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"
Jul 27 21:02:21.533250 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.533201    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb"} err="failed to get container status \"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb\": rpc error: code = NotFound desc = could not find container \"d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb\": container with ID starting with d16d258da6341b3c96bf1a42a66a3168b225b2427b6d9359ed0ea874a6ea3ebb not found: ID does not exist"
Jul 27 21:02:21.546011 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.545976    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:02:21.550125 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.550105    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dcdeec0f-859f65575b-t2cmt"]
Jul 27 21:02:21.984432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:21.984402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdcc8e5f-36fc-4490-86db-1aca2686236b" path="/var/lib/kubelet/pods/bdcc8e5f-36fc-4490-86db-1aca2686236b/volumes"
Jul 27 21:02:22.567415 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:22.567359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:25.297135 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.297100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:25.437491 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.437457    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:02:25.437704 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.437672    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy" containerID="cri-o://f6f453ab4bcf0f13242920060162a19b472893daea5edb5a5f460dbe539c0f9b" gracePeriod=30
Jul 27 21:02:25.468932 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.468897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:25.700425 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.700382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:25.944348 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:25.944307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:26.047344 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.047230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:26.189401 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.189367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:26.439716 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.439682    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:02:26.440285 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.440267    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdcc8e5f-36fc-4490-86db-1aca2686236b" containerName="payload-processing"
Jul 27 21:02:26.440338 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.440289    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdcc8e5f-36fc-4490-86db-1aca2686236b" containerName="payload-processing"
Jul 27 21:02:26.440373 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.440347    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdcc8e5f-36fc-4490-86db-1aca2686236b" containerName="payload-processing"
Jul 27 21:02:26.444808 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.444791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.447416 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.447396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4d77cbc3-gw-openshift-default-dockercfg-d5mqq\""
Jul 27 21:02:26.455060 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455261 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455261 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455353 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6h9z\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455353 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455353 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455481 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.455995 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.455975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:02:26.472637 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.472608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:26.556312 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6h9z\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556903 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556903 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556903 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.556903 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.557238 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.556947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.557304 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.557270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.558767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.558744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.558892 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.558874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.566902 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.566874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6h9z\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.567099 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.567080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token\") pod \"e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") " pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.613016 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.612982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:26.755749 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.755664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:26.890431 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.890391    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:02:26.902571 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:02:26.902539    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aaa49f2_d6fc_426b_afa4_ac8d38a4606f.slice/crio-95e8de42881736446d48aaf7d6c4415676a0ed32562e4aa883b0bad9d1c0e677 WatchSource:0}: Error finding container 95e8de42881736446d48aaf7d6c4415676a0ed32562e4aa883b0bad9d1c0e677: Status 404 returned error can't find the container with id 95e8de42881736446d48aaf7d6c4415676a0ed32562e4aa883b0bad9d1c0e677
Jul 27 21:02:26.904864 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.904830    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:26.904942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.904902    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:26.904942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:26.904932    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:27.563417 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:27.563381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerStarted","Data":"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"}
Jul 27 21:02:27.563762 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:27.563452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerStarted","Data":"95e8de42881736446d48aaf7d6c4415676a0ed32562e4aa883b0bad9d1c0e677"}
Jul 27 21:02:27.585165 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:27.585113    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podStartSLOduration=1.585093551 podStartE2EDuration="1.585093551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:27.582351077 +0000 UTC m=+1646.186835973" watchObservedRunningTime="2026-07-27 21:02:27.585093551 +0000 UTC m=+1646.189578428"
Jul 27 21:02:27.756854 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:27.756821    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:27.761519 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:27.761496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:28.568795 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:28.568765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:28.569588 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:28.569568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:29.057590 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:29.057559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:29.168686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:29.168653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:29.427818 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:29.427776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:29.779794 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:29.779718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:29.881935 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:29.881894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:02:30.582971 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.582940    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerID="f6f453ab4bcf0f13242920060162a19b472893daea5edb5a5f460dbe539c0f9b" exitCode=0
Jul 27 21:02:30.583111 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.583020    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerDied","Data":"f6f453ab4bcf0f13242920060162a19b472893daea5edb5a5f460dbe539c0f9b"}
Jul 27 21:02:30.583111 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.583097    2563 scope.go:117] "RemoveContainer" containerID="1a754e4baadb205ee62e86be2153fb3792bc15eff129f818d76a57765bbf5240"
Jul 27 21:02:30.694454 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.694429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:02:30.801727 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801656    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.801727 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6q4m\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801794    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert\") pod \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\" (UID: \"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1\") "
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.801935    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:30.802253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:30.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802261    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:30.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802356    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802370    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:30.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802377    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.802677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.802603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:30.804131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.804097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:30.804131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.804115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:30.804355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.804335    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m" (OuterVolumeSpecName: "kube-api-access-k6q4m") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "kube-api-access-k6q4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:30.804497 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.804480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" (UID: "5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:02:30.903532 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903499    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6q4m\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-kube-api-access-k6q4m\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903532 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903534    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903548    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903561    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903575    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903588    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:30.903735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:30.903601    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:02:31.589647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.589613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l" event={"ID":"5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1","Type":"ContainerDied","Data":"1d0d788e0cc62ad1aba7951242289aa0174999cd0ef0c609eae5097aad1e12e3"}
Jul 27 21:02:31.589825 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.589694    2563 scope.go:117] "RemoveContainer" containerID="f6f453ab4bcf0f13242920060162a19b472893daea5edb5a5f460dbe539c0f9b"
Jul 27 21:02:31.589825 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.589622    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"
Jul 27 21:02:31.617176 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.617151    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:02:31.623833 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.623812    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dcdeec0f-openshift-default-568d7d86d8-mxw6l"]
Jul 27 21:02:31.983056 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:31.983028    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" path="/var/lib/kubelet/pods/5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1/volumes"
Jul 27 21:02:43.570019 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.569983    2563 patch_prober.go:28] interesting pod/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 21:02:43.570440 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.570045    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 21:02:43.657185 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.657156    2563 generic.go:356] "Generic (PLEG): container finished" podID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerID="57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981" exitCode=0
Jul 27 21:02:43.657361 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.657243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerDied","Data":"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"}
Jul 27 21:02:43.657660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.657644    2563 scope.go:117] "RemoveContainer" containerID="57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"
Jul 27 21:02:43.658772 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.658746    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:43.658841 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.658825    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:43.658910 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:43.658896    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:02:44.664263 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:44.664232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerStarted","Data":"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"}
Jul 27 21:02:44.756322 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:44.756286    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:44.756530 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:44.756508    2563 patch_prober.go:28] interesting pod/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 21:02:44.756607 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:44.756568    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 21:02:45.756403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:45.756366    2563 patch_prober.go:28] interesting pod/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 21:02:45.756777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:45.756417    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 21:02:46.757030 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:46.756989    2563 patch_prober.go:28] interesting pod/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 21:02:46.757517 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:46.757053    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 21:02:47.756822 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:47.756785    2563 patch_prober.go:28] interesting pod/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 27 21:02:47.757036 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:47.756841    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 27 21:02:48.760077 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:48.760047    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:48.760454 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:48.760337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:02:48.761136 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:02:48.761117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:03:04.656324 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:04.656286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:04.722091 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:04.722033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:04.823474 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:04.823437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:09.148264 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.148226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:09.283477 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.283447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:03:09.283703 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.283664    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy" containerID="cri-o://195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161" gracePeriod=30
Jul 27 21:03:09.297245 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.297202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:09.525111 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.525074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:09.784115 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:09.784019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:10.050589 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.050505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:03:10.051076 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.051076 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051077    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.051188 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051092    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.051188 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.051258 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051198    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.051258 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.051210    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4a1bd6-5e2b-4ed4-90f9-9b14a8add6b1" containerName="istio-proxy"
Jul 27 21:03:10.053738 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.053721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.056141 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.056118    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-df7343e0-openshift-default-dockercfg-bjnvh\""
Jul 27 21:03:10.065788 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.065767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:03:10.085163 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.085135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:10.156843 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.156806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.156898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.156945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dv5v\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.157504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.157258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258120 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dv5v\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258593 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258593 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258593 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258593 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258743 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258817 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.258918 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.258901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.259465 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.259444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.260511 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.260491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.260778 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.260759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.266288 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.266267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.267022 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.267001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dv5v\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v\") pod \"e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") " pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.279710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.279662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:10.364220 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.364151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:10.499084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.499060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:03:10.500547 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:03:10.500524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3570971_3f3f_4322_af55_3f733fb6ef9c.slice/crio-a11369635e253f9e222d68df33669b4dfbd2513afe04853c139f717a519e6ad7 WatchSource:0}: Error finding container a11369635e253f9e222d68df33669b4dfbd2513afe04853c139f717a519e6ad7: Status 404 returned error can't find the container with id a11369635e253f9e222d68df33669b4dfbd2513afe04853c139f717a519e6ad7
Jul 27 21:03:10.502645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.502616    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:10.502743 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.502694    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:10.502801 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.502740    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:10.801258 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.801219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerStarted","Data":"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"}
Jul 27 21:03:10.801456 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.801282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerStarted","Data":"a11369635e253f9e222d68df33669b4dfbd2513afe04853c139f717a519e6ad7"}
Jul 27 21:03:10.831000 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:10.830931    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podStartSLOduration=0.830915991 podStartE2EDuration="830.915991ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:10.828170694 +0000 UTC m=+1689.432655569" watchObservedRunningTime="2026-07-27 21:03:10.830915991 +0000 UTC m=+1689.435400865"
Jul 27 21:03:11.364447 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:11.364412    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:11.369360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:11.369334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:11.806330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:11.806300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:11.807170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:11.807151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:12.165577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:12.165544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:12.254876 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:12.254840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:12.323318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:12.323283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:12.989217 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:12.989185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:13.081759 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:13.081723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:14.537305 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.537284    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:03:14.597720 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597644    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.597858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597730    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.597858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.597858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.597858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.597858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6h9z\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.597991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy\") pod \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\" (UID: \"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f\") "
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598080    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598120    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:14.598170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598149    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:14.598484 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598427    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.598484 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598448    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.598484 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598462    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.598484 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598467    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:14.598732 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.598709    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:14.600029 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.600002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:03:14.600141 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.600087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z" (OuterVolumeSpecName: "kube-api-access-k6h9z") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "kube-api-access-k6h9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:14.600455 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.600433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:03:14.600455 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.600444    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" (UID: "3aaa49f2-d6fc-426b-afa4-ac8d38a4606f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:14.699239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699211    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6h9z\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-kube-api-access-k6h9z\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.699239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699235    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.699239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699245    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.699444 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699254    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.699444 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699262    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.699444 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.699271    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:03:14.825117 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.825086    2563 generic.go:356] "Generic (PLEG): container finished" podID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerID="195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161" exitCode=0
Jul 27 21:03:14.825270 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.825139    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"
Jul 27 21:03:14.825270 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.825171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerDied","Data":"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"}
Jul 27 21:03:14.825270 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.825238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj" event={"ID":"3aaa49f2-d6fc-426b-afa4-ac8d38a4606f","Type":"ContainerDied","Data":"95e8de42881736446d48aaf7d6c4415676a0ed32562e4aa883b0bad9d1c0e677"}
Jul 27 21:03:14.825270 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.825268    2563 scope.go:117] "RemoveContainer" containerID="195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"
Jul 27 21:03:14.836894 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.836875    2563 scope.go:117] "RemoveContainer" containerID="57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"
Jul 27 21:03:14.844837 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.844816    2563 scope.go:117] "RemoveContainer" containerID="195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"
Jul 27 21:03:14.845305 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:03:14.845257    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161\": container with ID starting with 195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161 not found: ID does not exist" containerID="195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"
Jul 27 21:03:14.845305 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.845293    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161"} err="failed to get container status \"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161\": rpc error: code = NotFound desc = could not find container \"195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161\": container with ID starting with 195559d2425962230382de535372de066d160e5f6201b92b528c686553d6c161 not found: ID does not exist"
Jul 27 21:03:14.845488 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.845316    2563 scope.go:117] "RemoveContainer" containerID="57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"
Jul 27 21:03:14.845814 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:03:14.845794    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981\": container with ID starting with 57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981 not found: ID does not exist" containerID="57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"
Jul 27 21:03:14.845890 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.845822    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981"} err="failed to get container status \"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981\": rpc error: code = NotFound desc = could not find container \"57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981\": container with ID starting with 57dae8966b7312440ee7dfb4354bd9e991b13165b639c700aa8ffac817416981 not found: ID does not exist"
Jul 27 21:03:14.847664 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.847645    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:03:14.851675 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:14.851626    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4d77cbc3-gw-openshift-default-b6bcd84fb-n4hgj"]
Jul 27 21:03:15.984110 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:15.984075    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" path="/var/lib/kubelet/pods/3aaa49f2-d6fc-426b-afa4-ac8d38a4606f/volumes"
Jul 27 21:03:26.808367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.808285    2563 patch_prober.go:28] interesting pod/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 21:03:26.808367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.808351    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 21:03:26.890947 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.890914    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerID="31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48" exitCode=0
Jul 27 21:03:26.891107 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.890991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerDied","Data":"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"}
Jul 27 21:03:26.891385 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.891370    2563 scope.go:117] "RemoveContainer" containerID="31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"
Jul 27 21:03:26.892498 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.892470    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:26.892565 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.892555    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:26.892601 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:26.892589    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:27.902200 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:27.902169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerStarted","Data":"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"}
Jul 27 21:03:28.364641 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:28.364606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:28.364826 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:28.364809    2563 patch_prober.go:28] interesting pod/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 21:03:28.364893 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:28.364861    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 21:03:29.365495 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:29.365458    2563 patch_prober.go:28] interesting pod/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 21:03:29.365907 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:29.365516    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 21:03:30.365563 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:30.365527    2563 patch_prober.go:28] interesting pod/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 21:03:30.365985 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:30.365587    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 21:03:31.365244 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:31.365204    2563 patch_prober.go:28] interesting pod/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 27 21:03:31.365431 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:31.365278    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 27 21:03:32.368186 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:32.368161    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:32.368572 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:32.368507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:32.369158 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:32.369143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:03:49.743210 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:49.743170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:50.085507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:50.085409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:50.148110 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:50.148080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:54.343892 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:54.343856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:55.522394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:55.522359    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:03:55.522870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:55.522631    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy" containerID="cri-o://752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9" gracePeriod=30
Jul 27 21:03:55.538718 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:55.538687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:55.795124 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:55.795035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:56.042748 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.042715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:56.359711 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.359682    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:03:56.360079 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360066    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.360131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360081    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.360131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360094    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.360131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.360227 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360156    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.360227 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.360164    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aaa49f2-d6fc-426b-afa4-ac8d38a4606f" containerName="istio-proxy"
Jul 27 21:03:56.363309 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.363294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.366412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.366383    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-544e36ef-openshift-default-dockercfg-hd76j\""
Jul 27 21:03:56.377768 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.377744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378056 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378181 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4s6\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378359 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378359 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378467 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.378467 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.378429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.379874 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.379853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:03:56.388073 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.388050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:56.479880 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.479843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.479896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.479935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4s6\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480748 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.480870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.480749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.481028 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.481003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.481387 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.481370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.482762 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.482742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.482843 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.482788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.488582 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.488554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.488755 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.488736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4s6\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6\") pod \"e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") " pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.533191 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.533157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:56.674154 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.674123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:56.816721 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.816687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:03:56.820134 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:03:56.820106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c8a923_9f84_4ef9_b4ff_cc9f6eb5b163.slice/crio-f144ebc80d582fdf11d18360c2794e5178c57ae260099fc3199a4c5ad304e650 WatchSource:0}: Error finding container f144ebc80d582fdf11d18360c2794e5178c57ae260099fc3199a4c5ad304e650: Status 404 returned error can't find the container with id f144ebc80d582fdf11d18360c2794e5178c57ae260099fc3199a4c5ad304e650
Jul 27 21:03:56.822226 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.822191    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:56.822303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.822254    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:56.822303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:56.822288    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:03:57.066143 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:57.066053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerStarted","Data":"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"}
Jul 27 21:03:57.066143 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:57.066113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerStarted","Data":"f144ebc80d582fdf11d18360c2794e5178c57ae260099fc3199a4c5ad304e650"}
Jul 27 21:03:57.086654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:57.086610    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podStartSLOduration=1.086595893 podStartE2EDuration="1.086595893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:57.083773269 +0000 UTC m=+1735.688258145" watchObservedRunningTime="2026-07-27 21:03:57.086595893 +0000 UTC m=+1735.691080768"
Jul 27 21:03:57.675275 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:57.675162    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:57.681553 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:57.681524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:58.071021 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.070945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:58.072013 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.071992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:03:58.442207 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.442178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:58.532789 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.532753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:58.602359 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.602317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:58.829084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:58.828993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:59.253574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:59.253542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:03:59.346574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:03:59.346541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:00.774918 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.774895    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:04:00.819215 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819139    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819215 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819423 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819228    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819423 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819423 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819423 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dv5v\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819423 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819420    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819472    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket\") pod \"d3570971-3f3f-4322-af55-3f733fb6ef9c\" (UID: \"d3570971-3f3f-4322-af55-3f733fb6ef9c\") "
Jul 27 21:04:00.819686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:00.819906 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:00.819906 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819823    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3570971-3f3f-4322-af55-3f733fb6ef9c-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.819906 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819842    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.819906 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:00.820135 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.819903    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:00.820892 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.820861    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:00.821675 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.821651    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:00.821804 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.821698    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:00.822106 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.822080    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:04:00.822106 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.822082    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v" (OuterVolumeSpecName: "kube-api-access-7dv5v") pod "d3570971-3f3f-4322-af55-3f733fb6ef9c" (UID: "d3570971-3f3f-4322-af55-3f733fb6ef9c"). InnerVolumeSpecName "kube-api-access-7dv5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:00.920844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920811    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.920844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920839    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.920844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920848    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.921084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920857    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.921084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920865    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.921084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920873    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3570971-3f3f-4322-af55-3f733fb6ef9c-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:00.921084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:00.920881    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dv5v\" (UniqueName: \"kubernetes.io/projected/d3570971-3f3f-4322-af55-3f733fb6ef9c-kube-api-access-7dv5v\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:01.089867 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.089777    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerID="752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9" exitCode=0
Jul 27 21:04:01.089867 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.089834    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"
Jul 27 21:04:01.090077 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.089865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerDied","Data":"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"}
Jul 27 21:04:01.090077 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.089920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6" event={"ID":"d3570971-3f3f-4322-af55-3f733fb6ef9c","Type":"ContainerDied","Data":"a11369635e253f9e222d68df33669b4dfbd2513afe04853c139f717a519e6ad7"}
Jul 27 21:04:01.090077 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.089944    2563 scope.go:117] "RemoveContainer" containerID="752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"
Jul 27 21:04:01.099610 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.099594    2563 scope.go:117] "RemoveContainer" containerID="31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"
Jul 27 21:04:01.107731 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.107713    2563 scope.go:117] "RemoveContainer" containerID="752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"
Jul 27 21:04:01.108008 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:04:01.107985    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9\": container with ID starting with 752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9 not found: ID does not exist" containerID="752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"
Jul 27 21:04:01.108104 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.108021    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9"} err="failed to get container status \"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9\": rpc error: code = NotFound desc = could not find container \"752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9\": container with ID starting with 752b7da969efd67a8586546fc1c9292949e0ddea8aa39ddef28197c0ddbc76b9 not found: ID does not exist"
Jul 27 21:04:01.108104 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.108045    2563 scope.go:117] "RemoveContainer" containerID="31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"
Jul 27 21:04:01.108317 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:04:01.108298    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48\": container with ID starting with 31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48 not found: ID does not exist" containerID="31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"
Jul 27 21:04:01.108356 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.108326    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48"} err="failed to get container status \"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48\": rpc error: code = NotFound desc = could not find container \"31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48\": container with ID starting with 31773dbf60a3f67a8539d12cf78af420b98b4731ef20a853fb1fe8ebeaf07d48 not found: ID does not exist"
Jul 27 21:04:01.113425 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.113404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:04:01.120594 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.120573    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-df7343e0-openshift-default-6869c7bdd-26qf6"]
Jul 27 21:04:01.984287 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:01.984252    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" path="/var/lib/kubelet/pods/d3570971-3f3f-4322-af55-3f733fb6ef9c/volumes"
Jul 27 21:04:11.143486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.143452    2563 generic.go:356] "Generic (PLEG): container finished" podID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerID="01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a" exitCode=0
Jul 27 21:04:11.143902 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.143508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerDied","Data":"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"}
Jul 27 21:04:11.143902 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.143855    2563 scope.go:117] "RemoveContainer" containerID="01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"
Jul 27 21:04:11.144836 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.144810    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:04:11.144907 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.144892    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:04:11.144947 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:11.144929    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:04:12.151288 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:12.151254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerStarted","Data":"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"}
Jul 27 21:04:12.674669 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:12.674630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:12.675819 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:12.675781    2563 patch_prober.go:28] interesting pod/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 21:04:12.675984 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:12.675846    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 21:04:13.071521 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:13.071436    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:13.675556 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:13.675518    2563 patch_prober.go:28] interesting pod/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 21:04:13.676160 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:13.676125    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 21:04:14.675377 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:14.674880    2563 patch_prober.go:28] interesting pod/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 21:04:14.675377 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:14.674954    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 21:04:15.675456 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:15.675414    2563 patch_prober.go:28] interesting pod/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 21:04:15.675956 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:15.675502    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 21:04:16.678732 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:16.678700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:16.679749 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:16.679729    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:33.785530 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:33.785489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:33.846580 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:33.846542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:33.908844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:33.908805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:38.400754 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:38.400715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:38.565895 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:38.565856    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:04:38.566676 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:38.566634    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy" containerID="cri-o://8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed" gracePeriod=30
Jul 27 21:04:38.584187 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:38.584156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:38.830688 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:38.830636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:39.345892 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:39.345856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:39.447038 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:39.447005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:39.544793 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:39.544760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:41.041785 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:41.041752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:43.824979 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.824939    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:43.907635 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907635 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj4s6\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907635 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907688    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907787    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907864    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token\") pod \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\" (UID: \"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163\") "
Jul 27 21:04:43.907933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907948    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.907992    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.908270    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.908291    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.908306    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:43.908355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.908334    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:04:43.908993 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.908937    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data" (OuterVolumeSpecName: "istio-data") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:43.910049 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.910022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:04:43.910049 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.910036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6" (OuterVolumeSpecName: "kube-api-access-kj4s6") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "kube-api-access-kj4s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:43.910192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.910085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:04:43.910192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:43.910116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token" (OuterVolumeSpecName: "istio-token") pod "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" (UID: "23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:04:44.009299 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009275    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.009299 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009296    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.009441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009305    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.009441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009313    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.009441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009321    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj4s6\" (UniqueName: \"kubernetes.io/projected/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-kube-api-access-kj4s6\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.009441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.009329    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:04:44.324556 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.324509    2563 generic.go:356] "Generic (PLEG): container finished" podID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerID="8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed" exitCode=0
Jul 27 21:04:44.324556 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.324553    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"
Jul 27 21:04:44.324767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.324576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerDied","Data":"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"}
Jul 27 21:04:44.324767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.324626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z" event={"ID":"23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163","Type":"ContainerDied","Data":"f144ebc80d582fdf11d18360c2794e5178c57ae260099fc3199a4c5ad304e650"}
Jul 27 21:04:44.324767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.324656    2563 scope.go:117] "RemoveContainer" containerID="8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"
Jul 27 21:04:44.333544 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.333527    2563 scope.go:117] "RemoveContainer" containerID="01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"
Jul 27 21:04:44.342219 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.342198    2563 scope.go:117] "RemoveContainer" containerID="8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"
Jul 27 21:04:44.342506 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:04:44.342487    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed\": container with ID starting with 8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed not found: ID does not exist" containerID="8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"
Jul 27 21:04:44.342592 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.342517    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed"} err="failed to get container status \"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed\": rpc error: code = NotFound desc = could not find container \"8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed\": container with ID starting with 8613ab9126577e2157f7e00fdd4c452f6f9c9df66ca3d98c5f442164753ac5ed not found: ID does not exist"
Jul 27 21:04:44.342592 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.342543    2563 scope.go:117] "RemoveContainer" containerID="01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"
Jul 27 21:04:44.342823 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:04:44.342805    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a\": container with ID starting with 01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a not found: ID does not exist" containerID="01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"
Jul 27 21:04:44.342868 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.342830    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a"} err="failed to get container status \"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a\": rpc error: code = NotFound desc = could not find container \"01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a\": container with ID starting with 01ae397026d6035e652282db320f02e8f22c3b6bb3244a4ad7e03095dc7dad6a not found: ID does not exist"
Jul 27 21:04:44.343131 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.343114    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:04:44.346498 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:44.346475    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-544e36ef-openshift-default-fc797fb6d-lsn4z"]
Jul 27 21:04:45.984014 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:45.983981    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" path="/var/lib/kubelet/pods/23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163/volumes"
Jul 27 21:04:47.315874 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:47.315790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:47.424886 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:47.424852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:47.512882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:47.512843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:47.617482 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:47.617394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:04:48.136132 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:04:48.136085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:14.085002 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:14.084952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.663695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:20.663621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.811673 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:20.811637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:20.896385 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:20.896344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:36.765334 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:36.765295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:42.411245 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:42.411213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:42.470986 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:42.470935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:42.561654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:42.561619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:42.655203 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:42.655173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:53.119819 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:53.119775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:05:53.920208 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:05:53.920173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:00.533140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:00.533098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:00.644715 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:00.644665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:00.734737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:00.734701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:00.835226 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:00.835141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:01.616456 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:01.616425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:01.712720 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:01.712682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:01.811943 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:01.811910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:03.373094 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:03.373049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:09.188427 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:09.188387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:10.073848 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:10.073807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:10.218565 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:10.218524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:10.757339 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:10.757305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:16.702199 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:16.702161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:16.800547 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:16.800516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:16.954800 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:16.954726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:17.267227 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267152    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:17.267531 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267518    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:17.267574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267532    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:17.267574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267557    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:17.267574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267564    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:17.267574 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267572    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267578    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267590    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267640    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267646    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.267708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.267654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3570971-3f3f-4322-af55-3f733fb6ef9c" containerName="istio-proxy"
Jul 27 21:06:17.269975 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.269947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.273934 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.273900    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ded28f10-openshift-default-dockercfg-zjwgp\""
Jul 27 21:06:17.329122 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.329504 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.329450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjb2g\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.335943 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.335910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:17.341897 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.336695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:17.430330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjb2g\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430945 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430945 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430945 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430945 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.430945 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.430934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.431243 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.431226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.432628 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.432606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.432898 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.432881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.442821 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.442796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.442924 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.442822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjb2g\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g\") pod \"e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") " pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.511647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.511619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:17.582156 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.582077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:17.725434 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.725404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:17.727526 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:06:17.727499    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ac2328_c86f_43ea_bf93_7899ee5e958d.slice/crio-0cc2a448225783abe5919e415a6a928dbb7ec42b99a2fe41776663b9267c3454 WatchSource:0}: Error finding container 0cc2a448225783abe5919e415a6a928dbb7ec42b99a2fe41776663b9267c3454: Status 404 returned error can't find the container with id 0cc2a448225783abe5919e415a6a928dbb7ec42b99a2fe41776663b9267c3454
Jul 27 21:06:17.729623 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.729591    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:17.729730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.729656    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:17.729730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.729684    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:17.834760 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.834682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerStarted","Data":"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"}
Jul 27 21:06:17.834904 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.834789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerStarted","Data":"0cc2a448225783abe5919e415a6a928dbb7ec42b99a2fe41776663b9267c3454"}
Jul 27 21:06:17.855091 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:17.855032    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podStartSLOduration=0.855011706 podStartE2EDuration="855.011706ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:17.853901991 +0000 UTC m=+1876.458386880" watchObservedRunningTime="2026-07-27 21:06:17.855011706 +0000 UTC m=+1876.459496581"
Jul 27 21:06:18.583084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:18.583048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:18.588908 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:18.588879    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:18.839667 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:18.839584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:18.840517 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:18.840496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:20.130434 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:20.130392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:20.217937 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:20.217904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:20.289455 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:20.289419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:20.389725 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:20.389637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:21.072689 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.072655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:21.166499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.166462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:21.277098 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.277063    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:21.277728 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.277706    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c8a923-9f84-4ef9-b4ff-cc9f6eb5b163" containerName="istio-proxy"
Jul 27 21:06:21.280926 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.280899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.283249 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.283224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ded28f10-dockercfg-xftw9\""
Jul 27 21:06:21.283425 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.283407    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ded28f10\""
Jul 27 21:06:21.290356 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.290326    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:21.365942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.365854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv546\" (UniqueName: \"kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.366134 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.366026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.467244 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.467215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.467410 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.467269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv546\" (UniqueName: \"kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.467939 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.467916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.475384 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.475357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv546\" (UniqueName: \"kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546\") pod \"payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") " pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.596510 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.596475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:21.946038 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:21.946011    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:21.947691 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:06:21.947667    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152d2f55_5eb0_4d48_ba7f_7821dd92b42e.slice/crio-bc747b10d20129baa6e732cbfafc8cfb04ad414485f097d8596caad8712390fd WatchSource:0}: Error finding container bc747b10d20129baa6e732cbfafc8cfb04ad414485f097d8596caad8712390fd: Status 404 returned error can't find the container with id bc747b10d20129baa6e732cbfafc8cfb04ad414485f097d8596caad8712390fd
Jul 27 21:06:22.863624 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:22.863587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" event={"ID":"152d2f55-5eb0-4d48-ba7f-7821dd92b42e","Type":"ContainerStarted","Data":"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"}
Jul 27 21:06:22.864144 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:22.863637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" event={"ID":"152d2f55-5eb0-4d48-ba7f-7821dd92b42e","Type":"ContainerStarted","Data":"bc747b10d20129baa6e732cbfafc8cfb04ad414485f097d8596caad8712390fd"}
Jul 27 21:06:22.864144 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:22.863738    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:22.881172 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:22.881128    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" podStartSLOduration=1.881108563 podStartE2EDuration="1.881108563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:22.87824281 +0000 UTC m=+1881.482727686" watchObservedRunningTime="2026-07-27 21:06:22.881108563 +0000 UTC m=+1881.485593440"
Jul 27 21:06:24.566612 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:24.566525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:25.197427 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:25.197331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:25.294485 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:25.294447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:25.641797 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:25.641700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:31.302903 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.302849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:31.405653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.405554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:31.922305 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.922269    2563 generic.go:356] "Generic (PLEG): container finished" podID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerID="5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418" exitCode=0
Jul 27 21:06:31.922485 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.922341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerDied","Data":"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"}
Jul 27 21:06:31.922826 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.922808    2563 scope.go:117] "RemoveContainer" containerID="5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"
Jul 27 21:06:31.923757 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.923733    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:31.923810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.923798    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:31.923850 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:31.923829    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:06:32.929555 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:32.929514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerStarted","Data":"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"}
Jul 27 21:06:33.582537 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:33.582494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:33.584044 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:33.584008    2563 patch_prober.go:28] interesting pod/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 27 21:06:33.584184 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:33.584083    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 27 21:06:33.839695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:33.839610    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:33.870790 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:33.870764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:34.582753 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:34.582709    2563 patch_prober.go:28] interesting pod/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 27 21:06:34.583309 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:34.582780    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 27 21:06:35.583188 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:35.583147    2563 patch_prober.go:28] interesting pod/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 27 21:06:35.583720 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:35.583221    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 27 21:06:36.583382 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:36.583340    2563 patch_prober.go:28] interesting pod/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 27 21:06:36.584010 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:36.583957    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 27 21:06:37.587582 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:37.587556    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:37.588480 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:37.588461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:41.945745 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:41.945704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:41.975544 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:41.975497    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:41.975755 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:41.975724    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" podUID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" containerName="payload-processing" containerID="cri-o://7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7" gracePeriod=30
Jul 27 21:06:42.021157 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.021127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:42.087900 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.087863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:42.241137 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.241105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:42.366199 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.366170    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv546\" (UniqueName: \"kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546\") pod \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") "
Jul 27 21:06:42.366392 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.366272    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume\") pod \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\" (UID: \"152d2f55-5eb0-4d48-ba7f-7821dd92b42e\") "
Jul 27 21:06:42.366705 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.366677    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "152d2f55-5eb0-4d48-ba7f-7821dd92b42e" (UID: "152d2f55-5eb0-4d48-ba7f-7821dd92b42e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:06:42.368319 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.368279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546" (OuterVolumeSpecName: "kube-api-access-qv546") pod "152d2f55-5eb0-4d48-ba7f-7821dd92b42e" (UID: "152d2f55-5eb0-4d48-ba7f-7821dd92b42e"). InnerVolumeSpecName "kube-api-access-qv546". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:42.467632 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.467606    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv546\" (UniqueName: \"kubernetes.io/projected/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-kube-api-access-qv546\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.467632 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.467629    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/152d2f55-5eb0-4d48-ba7f-7821dd92b42e-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:42.984649 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.984611    2563 generic.go:356] "Generic (PLEG): container finished" podID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" containerID="7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7" exitCode=0
Jul 27 21:06:42.985138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.984654    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"
Jul 27 21:06:42.985138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.984676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" event={"ID":"152d2f55-5eb0-4d48-ba7f-7821dd92b42e","Type":"ContainerDied","Data":"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"}
Jul 27 21:06:42.985138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.984720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s" event={"ID":"152d2f55-5eb0-4d48-ba7f-7821dd92b42e","Type":"ContainerDied","Data":"bc747b10d20129baa6e732cbfafc8cfb04ad414485f097d8596caad8712390fd"}
Jul 27 21:06:42.985138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.984743    2563 scope.go:117] "RemoveContainer" containerID="7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"
Jul 27 21:06:42.994719 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.994701    2563 scope.go:117] "RemoveContainer" containerID="7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"
Jul 27 21:06:42.994997 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:06:42.994977    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7\": container with ID starting with 7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7 not found: ID does not exist" containerID="7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"
Jul 27 21:06:42.995090 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:42.995005    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7"} err="failed to get container status \"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7\": rpc error: code = NotFound desc = could not find container \"7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7\": container with ID starting with 7abe04f2f6477ebd6a0c74f089112c9c3a04e7f9521efa83e9495c7c300aace7 not found: ID does not exist"
Jul 27 21:06:43.006033 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:43.006011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:43.011116 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:43.011084    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ded28f10-78ff9cf478-25p5s"]
Jul 27 21:06:43.983415 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:43.983383    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" path="/var/lib/kubelet/pods/152d2f55-5eb0-4d48-ba7f-7821dd92b42e/volumes"
Jul 27 21:06:46.799010 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:46.798979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:47.203013 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:47.202977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.047645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.047585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.148562 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.148528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.294931 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.294902    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:53.295181 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.295150    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy" containerID="cri-o://f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac" gracePeriod=30
Jul 27 21:06:53.316721 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.316604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.592403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.592315    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.702470 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.702439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.802389 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.802359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:53.900241 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:53.900150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:58.545049 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.545028    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:58.715573 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715592    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715643    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715732    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.715775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.716139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjb2g\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.716139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs\") pod \"13ac2328-c86f-43ea-bf93-7899ee5e958d\" (UID: \"13ac2328-c86f-43ea-bf93-7899ee5e958d\") "
Jul 27 21:06:58.716139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:58.716139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.715981    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:58.716357 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.716185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:58.716357 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.716231    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.716357 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.716250    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.716522 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.716494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:06:58.716589 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.716565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data" (OuterVolumeSpecName: "istio-data") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:58.718025 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.717993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:06:58.718025 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.718019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g" (OuterVolumeSpecName: "kube-api-access-zjb2g") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "kube-api-access-zjb2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:58.718303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.718281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token" (OuterVolumeSpecName: "istio-token") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:06:58.718366 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.718332    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13ac2328-c86f-43ea-bf93-7899ee5e958d" (UID: "13ac2328-c86f-43ea-bf93-7899ee5e958d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:06:58.817012 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.816948    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817012 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817009    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817012 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817022    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ac2328-c86f-43ea-bf93-7899ee5e958d-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817036    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjb2g\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-kube-api-access-zjb2g\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817049    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817060    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:58.817246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:58.817070    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ac2328-c86f-43ea-bf93-7899ee5e958d-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:06:59.074491 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.074412    2563 generic.go:356] "Generic (PLEG): container finished" podID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerID="f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac" exitCode=0
Jul 27 21:06:59.074491 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.074457    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"
Jul 27 21:06:59.074679 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.074494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerDied","Data":"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"}
Jul 27 21:06:59.074679 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.074548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp" event={"ID":"13ac2328-c86f-43ea-bf93-7899ee5e958d","Type":"ContainerDied","Data":"0cc2a448225783abe5919e415a6a928dbb7ec42b99a2fe41776663b9267c3454"}
Jul 27 21:06:59.074679 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.074570    2563 scope.go:117] "RemoveContainer" containerID="f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"
Jul 27 21:06:59.083767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.083749    2563 scope.go:117] "RemoveContainer" containerID="5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"
Jul 27 21:06:59.091804 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.091787    2563 scope.go:117] "RemoveContainer" containerID="f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"
Jul 27 21:06:59.092037 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:06:59.092018    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac\": container with ID starting with f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac not found: ID does not exist" containerID="f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"
Jul 27 21:06:59.092085 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.092045    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac"} err="failed to get container status \"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac\": rpc error: code = NotFound desc = could not find container \"f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac\": container with ID starting with f09d213b6edf397626e9a701b17e69614841ca466dbaeb689f6f97f883bd18ac not found: ID does not exist"
Jul 27 21:06:59.092085 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.092062    2563 scope.go:117] "RemoveContainer" containerID="5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"
Jul 27 21:06:59.092284 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:06:59.092269    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418\": container with ID starting with 5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418 not found: ID does not exist" containerID="5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"
Jul 27 21:06:59.092324 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.092288    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418"} err="failed to get container status \"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418\": rpc error: code = NotFound desc = could not find container \"5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418\": container with ID starting with 5e1f5c492c9307a6873aa2105e029e06daa70cc5f30f6b3a05a7a96c35689418 not found: ID does not exist"
Jul 27 21:06:59.096926 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.096906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:59.101816 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.101785    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ded28f10-openshift-default-6b8b9785fb-5rdkp"]
Jul 27 21:06:59.560856 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.560820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.621245 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.621212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.694704 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.694662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.795775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.795742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.911040 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.911010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:06:59.983633 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:06:59.983602    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" path="/var/lib/kubelet/pods/13ac2328-c86f-43ea-bf93-7899ee5e958d/volumes"
Jul 27 21:07:05.715262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:05.715221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:05.816590 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:05.816541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:12.464872 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.464837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:12.736611 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736532    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:07:12.736910 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736895    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.736989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736911    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.736989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736921    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" containerName="payload-processing"
Jul 27 21:07:12.736989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" containerName="payload-processing"
Jul 27 21:07:12.736989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736948    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.736989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.736954    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.737166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.737028    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="152d2f55-5eb0-4d48-ba7f-7821dd92b42e" containerName="payload-processing"
Jul 27 21:07:12.737166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.737040    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.737166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.737046    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ac2328-c86f-43ea-bf93-7899ee5e958d" containerName="istio-proxy"
Jul 27 21:07:12.739274 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.739249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.742414 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.742396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9d99757d-openshift-default-dockercfg-7mzqr\""
Jul 27 21:07:12.754288 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.754263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:07:12.767334 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.767304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:12.840381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840584 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840584 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840584 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840584 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840769 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840769 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840769 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt82h\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.840871 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.840796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942251 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942251 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt82h\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942899 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.942899 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.943029 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.942945    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.943029 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.943012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.943323 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.943299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.944736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.944709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.944854 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.944793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.960542 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.960514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.960765 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.960744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt82h\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h\") pod \"e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") " pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:12.972890 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:12.972861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:13.049931 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:13.049840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:13.193296 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:13.193261    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:07:13.194383 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:07:13.194353    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb2da54_a23f_4150_846a_81788df0bc1a.slice/crio-eed9a5677fa76471817b00dde1ec4d1e98120c8bd2e72aa7a88083f3d88d3f26 WatchSource:0}: Error finding container eed9a5677fa76471817b00dde1ec4d1e98120c8bd2e72aa7a88083f3d88d3f26: Status 404 returned error can't find the container with id eed9a5677fa76471817b00dde1ec4d1e98120c8bd2e72aa7a88083f3d88d3f26
Jul 27 21:07:13.196372 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:13.196335    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:13.196458 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:13.196403    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:13.196458 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:13.196430    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:14.162902 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:14.162864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerStarted","Data":"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"}
Jul 27 21:07:14.163345 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:14.162921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerStarted","Data":"eed9a5677fa76471817b00dde1ec4d1e98120c8bd2e72aa7a88083f3d88d3f26"}
Jul 27 21:07:14.183986 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:14.183915    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podStartSLOduration=2.183898904 podStartE2EDuration="2.183898904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:14.182085743 +0000 UTC m=+1932.786570630" watchObservedRunningTime="2026-07-27 21:07:14.183898904 +0000 UTC m=+1932.788383778"
Jul 27 21:07:15.050313 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:15.050268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:15.055300 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:15.055276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:15.168500 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:15.168467    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:15.169401 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:15.169384    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:16.119592 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.119521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.218225 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.218196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.293696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.293669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.463785 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.463753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.793548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.793455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.882870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.882830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:16.919449 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.919420    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:07:16.921843 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.921827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:16.924421 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.924402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9d99757d-dockercfg-gf2tj\""
Jul 27 21:07:16.924483 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.924427    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9d99757d\""
Jul 27 21:07:16.934482 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.934450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:07:16.977166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.977123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzwg\" (UniqueName: \"kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:16.977345 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:16.977168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.077998 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.077881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzwg\" (UniqueName: \"kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.077998 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.077915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.078779 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.078750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.087399 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.087377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzwg\" (UniqueName: \"kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg\") pod \"payload-processing-e2e-mt-9d99757d-997f67b86-74dw9\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") " pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.233619 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.233585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:17.400920 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:17.400888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:07:17.401045 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:07:17.400887    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda271326_a0c9_447c_96d4_0350e3d05e9a.slice/crio-ba859d496779b7c9ed400ee47a37f5d69f277503794ead3e834118ee35b6e994 WatchSource:0}: Error finding container ba859d496779b7c9ed400ee47a37f5d69f277503794ead3e834118ee35b6e994: Status 404 returned error can't find the container with id ba859d496779b7c9ed400ee47a37f5d69f277503794ead3e834118ee35b6e994
Jul 27 21:07:18.187332 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:18.187296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" event={"ID":"da271326-a0c9-447c-96d4-0350e3d05e9a","Type":"ContainerStarted","Data":"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"}
Jul 27 21:07:18.187515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:18.187358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" event={"ID":"da271326-a0c9-447c-96d4-0350e3d05e9a","Type":"ContainerStarted","Data":"ba859d496779b7c9ed400ee47a37f5d69f277503794ead3e834118ee35b6e994"}
Jul 27 21:07:18.187515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:18.187416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:18.202788 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:18.202745    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" podStartSLOduration=2.202732187 podStartE2EDuration="2.202732187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:18.202263613 +0000 UTC m=+1936.806748489" watchObservedRunningTime="2026-07-27 21:07:18.202732187 +0000 UTC m=+1936.807217062"
Jul 27 21:07:19.708515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:19.708478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:20.602848 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:20.602814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:29.194925 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:29.194873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:07:30.212105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.211117    2563 patch_prober.go:28] interesting pod/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:57054->10.133.0.58:15021: read: connection reset by peer" start-of-body=
Jul 27 21:07:30.212105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.211218    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": read tcp 10.133.0.2:57054->10.133.0.58:15021: read: connection reset by peer"
Jul 27 21:07:30.259643 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.259616    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerID="37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d" exitCode=0
Jul 27 21:07:30.259768 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.259696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerDied","Data":"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"}
Jul 27 21:07:30.260096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.260082    2563 scope.go:117] "RemoveContainer" containerID="37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"
Jul 27 21:07:30.261101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.261073    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:30.261209 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.261166    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:30.261276 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:30.261217    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:07:31.268130 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:31.268099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerStarted","Data":"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"}
Jul 27 21:07:32.050751 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:32.050720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:32.050934 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:32.050886    2563 patch_prober.go:28] interesting pod/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 21:07:32.051009 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:32.050929    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 21:07:33.050449 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:33.050408    2563 patch_prober.go:28] interesting pod/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 21:07:33.050870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:33.050470    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 21:07:34.051101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:34.051069    2563 patch_prober.go:28] interesting pod/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 21:07:34.051478 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:34.051120    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 21:07:35.050661 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:35.050625    2563 patch_prober.go:28] interesting pod/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 27 21:07:35.050845 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:35.050676    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 27 21:07:36.054368 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:36.054338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:36.054745 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:36.054666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:36.055394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:36.055373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:07:37.947014 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:37.946974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:07:53.476813 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:07:53.476717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:41.093105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.093066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:41.119775 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.119739    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:08:41.120004 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.119975    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" podUID="da271326-a0c9-447c-96d4-0350e3d05e9a" containerName="payload-processing" containerID="cri-o://3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65" gracePeriod=30
Jul 27 21:08:41.194179 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.194143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:41.300822 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.300790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:41.367600 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.367569    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:08:41.435565 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.435536    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume\") pod \"da271326-a0c9-447c-96d4-0350e3d05e9a\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") "
Jul 27 21:08:41.435720 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.435644    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldzwg\" (UniqueName: \"kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg\") pod \"da271326-a0c9-447c-96d4-0350e3d05e9a\" (UID: \"da271326-a0c9-447c-96d4-0350e3d05e9a\") "
Jul 27 21:08:41.435895 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.435873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da271326-a0c9-447c-96d4-0350e3d05e9a" (UID: "da271326-a0c9-447c-96d4-0350e3d05e9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:08:41.437789 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.437764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg" (OuterVolumeSpecName: "kube-api-access-ldzwg") pod "da271326-a0c9-447c-96d4-0350e3d05e9a" (UID: "da271326-a0c9-447c-96d4-0350e3d05e9a"). InnerVolumeSpecName "kube-api-access-ldzwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:41.536659 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.536626    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da271326-a0c9-447c-96d4-0350e3d05e9a-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.536659 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.536658    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldzwg\" (UniqueName: \"kubernetes.io/projected/da271326-a0c9-447c-96d4-0350e3d05e9a-kube-api-access-ldzwg\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:08:41.664571 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.664536    2563 generic.go:356] "Generic (PLEG): container finished" podID="da271326-a0c9-447c-96d4-0350e3d05e9a" containerID="3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65" exitCode=0
Jul 27 21:08:41.664736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.664592    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"
Jul 27 21:08:41.664736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.664625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" event={"ID":"da271326-a0c9-447c-96d4-0350e3d05e9a","Type":"ContainerDied","Data":"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"}
Jul 27 21:08:41.664736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.664699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9" event={"ID":"da271326-a0c9-447c-96d4-0350e3d05e9a","Type":"ContainerDied","Data":"ba859d496779b7c9ed400ee47a37f5d69f277503794ead3e834118ee35b6e994"}
Jul 27 21:08:41.664736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.664723    2563 scope.go:117] "RemoveContainer" containerID="3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"
Jul 27 21:08:41.674573 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.674552    2563 scope.go:117] "RemoveContainer" containerID="3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"
Jul 27 21:08:41.674859 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:08:41.674827    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65\": container with ID starting with 3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65 not found: ID does not exist" containerID="3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"
Jul 27 21:08:41.674954 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.674870    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65"} err="failed to get container status \"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65\": rpc error: code = NotFound desc = could not find container \"3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65\": container with ID starting with 3709d221b3f7a0a4d0582e70e7347ef3d0ba3bf86dd9c3acb0b0cba845a3ae65 not found: ID does not exist"
Jul 27 21:08:41.685928 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.685906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:08:41.689665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.689642    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d99757d-997f67b86-74dw9"]
Jul 27 21:08:41.984717 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:41.984644    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da271326-a0c9-447c-96d4-0350e3d05e9a" path="/var/lib/kubelet/pods/da271326-a0c9-447c-96d4-0350e3d05e9a/volumes"
Jul 27 21:08:45.724605 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:45.724565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:48.907756 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:48.907723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:08:53.949890 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:08:53.949845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:04.216575 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:04.216540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:23.707695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:23.707605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:30.179256 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:30.179217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:31.198653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:31.198621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:36.923153 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:36.923115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:36.996032 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:36.995990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:37.191568 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:37.191492    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:09:37.191785 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:37.191752    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy" containerID="cri-o://5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6" gracePeriod=30
Jul 27 21:09:37.217932 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:37.217905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:37.455164 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:37.455067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:38.515743 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:38.515706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:38.613363 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:38.613324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:38.714307 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:38.714270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:39.463819 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:39.463783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:39.563865 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:39.563818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:39.660235 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:39.660206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:41.056906 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:41.056875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:42.456787 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.456722    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:09:42.573281 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573243    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573479 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573479 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573321    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573591 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:42.573646 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt82h\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573717 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573679    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573772 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573772 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573878 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.573878 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.573841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket\") pod \"3cb2da54-a23f-4150-846a-81788df0bc1a\" (UID: \"3cb2da54-a23f-4150-846a-81788df0bc1a\") "
Jul 27 21:09:42.574622 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:42.574622 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574217    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.574622 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574233    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.574622 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:42.574622 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:42.575066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.574671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:09:42.576408 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.576379    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:09:42.576524 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.576413    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:42.576839 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.576809    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h" (OuterVolumeSpecName: "kube-api-access-jt82h") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "kube-api-access-jt82h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:42.576839 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.576818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cb2da54-a23f-4150-846a-81788df0bc1a" (UID: "3cb2da54-a23f-4150-846a-81788df0bc1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:42.675105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675067    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675098    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675110    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675338 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675123    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb2da54-a23f-4150-846a-81788df0bc1a-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675338 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675137    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb2da54-a23f-4150-846a-81788df0bc1a-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675338 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675149    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt82h\" (UniqueName: \"kubernetes.io/projected/3cb2da54-a23f-4150-846a-81788df0bc1a-kube-api-access-jt82h\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.675338 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.675159    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb2da54-a23f-4150-846a-81788df0bc1a-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:09:42.988059 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.988023    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerID="5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6" exitCode=0
Jul 27 21:09:42.988248 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.988096    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"
Jul 27 21:09:42.988248 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.988139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerDied","Data":"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"}
Jul 27 21:09:42.988248 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.988186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62" event={"ID":"3cb2da54-a23f-4150-846a-81788df0bc1a","Type":"ContainerDied","Data":"eed9a5677fa76471817b00dde1ec4d1e98120c8bd2e72aa7a88083f3d88d3f26"}
Jul 27 21:09:42.988248 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.988216    2563 scope.go:117] "RemoveContainer" containerID="5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"
Jul 27 21:09:42.998364 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:42.998345    2563 scope.go:117] "RemoveContainer" containerID="37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"
Jul 27 21:09:43.007369 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.007345    2563 scope.go:117] "RemoveContainer" containerID="5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"
Jul 27 21:09:43.007644 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:09:43.007619    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6\": container with ID starting with 5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6 not found: ID does not exist" containerID="5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"
Jul 27 21:09:43.007693 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.007653    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6"} err="failed to get container status \"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6\": rpc error: code = NotFound desc = could not find container \"5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6\": container with ID starting with 5891d40577dc903d6c808abc191e2ec72ccac047fe14dd3c9aac796de099aca6 not found: ID does not exist"
Jul 27 21:09:43.007693 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.007671    2563 scope.go:117] "RemoveContainer" containerID="37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"
Jul 27 21:09:43.007916 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:09:43.007893    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d\": container with ID starting with 37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d not found: ID does not exist" containerID="37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"
Jul 27 21:09:43.007993 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.007926    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d"} err="failed to get container status \"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d\": rpc error: code = NotFound desc = could not find container \"37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d\": container with ID starting with 37b6db10b5f48c894a2ba0badedbcf66754d350c5c13734dfec576524dcc493d not found: ID does not exist"
Jul 27 21:09:43.014169 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.014128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:09:43.016988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.016938    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9d99757d-openshift-default-55dd8fb68d-8bx62"]
Jul 27 21:09:43.984879 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:43.984843    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" path="/var/lib/kubelet/pods/3cb2da54-a23f-4150-846a-81788df0bc1a/volumes"
Jul 27 21:09:46.765610 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:46.765575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:46.865644 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:46.865601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:47.438273 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:47.438244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:53.401533 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:53.401498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:53.508464 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:53.508427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:09:53.602584 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:09:53.602555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:04.149434 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:04.149402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:04.492678 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:04.492639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:25.477613 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:25.477571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:32.428901 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:32.428855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:32.530112 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:32.530068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:32.779005 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:32.778884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:33.098522 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:10:33.098812 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098800    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:33.098866 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098814    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:33.098866 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098823    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da271326-a0c9-447c-96d4-0350e3d05e9a" containerName="payload-processing"
Jul 27 21:10:33.098866 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098830    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da271326-a0c9-447c-96d4-0350e3d05e9a" containerName="payload-processing"
Jul 27 21:10:33.098866 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098838    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:33.098866 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098843    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:33.099060 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:33.099060 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.098913    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da271326-a0c9-447c-96d4-0350e3d05e9a" containerName="payload-processing"
Jul 27 21:10:33.101155 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.101136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.104370 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.104350    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-00b3a2-openshift-default-dockercfg-4bw9g\""
Jul 27 21:10:33.123412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.123388    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:10:33.160078 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.160038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:33.224314 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224515 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.224733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.224604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2k5g\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.320098 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.320066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:33.325164 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325250 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325250 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325333 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325564 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2k5g\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325923 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325923 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.325923 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.325877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.326507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.326485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.327613 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.327592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.327829 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.327813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.335536 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.335505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2k5g\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.336828 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.336810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token\") pod \"e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") " pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.412185 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.412156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:33.544824 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.544798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:10:33.546724 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:10:33.546687    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286fd36a_ace7_4d28_95bc_6aab5a312fbf.slice/crio-1c064c852024314dbe6caad9f65a68b98364703501f455de102e8d2dcb5a3921 WatchSource:0}: Error finding container 1c064c852024314dbe6caad9f65a68b98364703501f455de102e8d2dcb5a3921: Status 404 returned error can't find the container with id 1c064c852024314dbe6caad9f65a68b98364703501f455de102e8d2dcb5a3921
Jul 27 21:10:33.549052 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.549019    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:33.549145 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.549084    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:33.549145 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:33.549119    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:34.271823 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:34.271792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerStarted","Data":"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"}
Jul 27 21:10:34.272057 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:34.271847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerStarted","Data":"1c064c852024314dbe6caad9f65a68b98364703501f455de102e8d2dcb5a3921"}
Jul 27 21:10:34.291783 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:34.291731    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podStartSLOduration=1.291715928 podStartE2EDuration="1.291715928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:34.289355909 +0000 UTC m=+2132.893840785" watchObservedRunningTime="2026-07-27 21:10:34.291715928 +0000 UTC m=+2132.896200803"
Jul 27 21:10:34.412568 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:34.412529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:34.417399 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:34.417373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:35.277718 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:35.277691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:35.278821 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:35.278796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:36.230312 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:36.230282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:36.330682 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:36.330650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:36.451200 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:36.451161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:36.645857 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:36.645767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:36.942730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:36.942702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:37.031899 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.031842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:37.066975 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.066911    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:10:37.067456 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.067436    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb2da54-a23f-4150-846a-81788df0bc1a" containerName="istio-proxy"
Jul 27 21:10:37.069613 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.069598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.072379 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.072361    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-00b3a2-dockercfg-4dp75\""
Jul 27 21:10:37.073012 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.072991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-00b3a2\""
Jul 27 21:10:37.084696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.084674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:10:37.159754 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.159718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsr67\" (UniqueName: \"kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.159990 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.159878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.261268 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.261189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsr67\" (UniqueName: \"kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.261422 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.261280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.261937 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.261918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.269054 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.269028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsr67\" (UniqueName: \"kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67\") pod \"payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") " pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.381705 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.381674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:37.513572 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:37.513522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:10:37.515651 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:10:37.515626    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cef29f_474f_4dc2_9de8_20df17347918.slice/crio-8bf369281d26bb6a5e659d2cb209f79af3644708c0bfd66d478171110956f44a WatchSource:0}: Error finding container 8bf369281d26bb6a5e659d2cb209f79af3644708c0bfd66d478171110956f44a: Status 404 returned error can't find the container with id 8bf369281d26bb6a5e659d2cb209f79af3644708c0bfd66d478171110956f44a
Jul 27 21:10:38.295525 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:38.295488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" event={"ID":"28cef29f-474f-4dc2-9de8-20df17347918","Type":"ContainerStarted","Data":"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"}
Jul 27 21:10:38.295701 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:38.295545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" event={"ID":"28cef29f-474f-4dc2-9de8-20df17347918","Type":"ContainerStarted","Data":"8bf369281d26bb6a5e659d2cb209f79af3644708c0bfd66d478171110956f44a"}
Jul 27 21:10:38.295701 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:38.295623    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:38.312528 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:38.312483    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" podStartSLOduration=1.3124701060000001 podStartE2EDuration="1.312470106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:38.310671997 +0000 UTC m=+2136.915156873" watchObservedRunningTime="2026-07-27 21:10:38.312470106 +0000 UTC m=+2136.916955047"
Jul 27 21:10:40.728811 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:40.728765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:41.059323 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.059204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:41.417184 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.417148    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:10:41.419712 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.419695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.421999 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.421951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c7d2ad-openshift-default-dockercfg-84w7l\""
Jul 27 21:10:41.431648 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.431624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:10:41.444162 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.444137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:41.601183 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601381 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601638 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601638 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.601638 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.601478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b88p\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702193 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702193 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702193 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702446 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702446 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702446 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702446 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b88p\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.702867 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.703014 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.702997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.703136 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.703117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.704628 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.704603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.704767 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.704749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.709645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.709624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.710093 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.710071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b88p\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p\") pod \"e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") " pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.728395 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.728352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:41.731243 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.731212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:41.865823 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.865798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:10:41.867833 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:10:41.867811    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd851998b_f357_4ac0_b599_ab579e275abb.slice/crio-34b9079876035673c677616718883d6b079de5f3edcd6b95d27444909513a39a WatchSource:0}: Error finding container 34b9079876035673c677616718883d6b079de5f3edcd6b95d27444909513a39a: Status 404 returned error can't find the container with id 34b9079876035673c677616718883d6b079de5f3edcd6b95d27444909513a39a
Jul 27 21:10:41.870020 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.869991    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:41.870138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.870066    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:41.870138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:41.870111    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:42.319808 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:42.319775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerStarted","Data":"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"}
Jul 27 21:10:42.320017 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:42.319828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerStarted","Data":"34b9079876035673c677616718883d6b079de5f3edcd6b95d27444909513a39a"}
Jul 27 21:10:42.339411 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:42.339366    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podStartSLOduration=1.339347451 podStartE2EDuration="1.339347451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:42.338583701 +0000 UTC m=+2140.943068597" watchObservedRunningTime="2026-07-27 21:10:42.339347451 +0000 UTC m=+2140.943832336"
Jul 27 21:10:42.732378 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:42.732351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:42.737192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:42.737168    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:43.325075 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:43.325044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:43.326034 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:43.326018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:10:44.242281 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:44.242242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:44.335543 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:44.335507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:44.402249 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:44.402217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:44.706613 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:44.706576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:44.934066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:44.934030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:45.040879 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:45.040784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:49.238114 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:49.238073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:10:49.303719 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:49.303682    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:10:51.295388 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.294478    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 21:10:51.295388 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.294537    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 21:10:51.372287 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.372258    2563 generic.go:356] "Generic (PLEG): container finished" podID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerID="623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49" exitCode=0
Jul 27 21:10:51.372449 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.372336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerDied","Data":"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"}
Jul 27 21:10:51.372823 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.372806    2563 scope.go:117] "RemoveContainer" containerID="623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"
Jul 27 21:10:51.374319 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.374276    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:51.374426 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.374356    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:51.374426 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:51.374402    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:10:52.383653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:52.383619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerStarted","Data":"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"}
Jul 27 21:10:52.413315 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:52.413285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:52.413505 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:52.413454    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:10:52.413505 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:52.413496    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:10:53.415060 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:53.415014    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:10:53.415568 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:53.415088    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:10:54.412695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:54.412653    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:10:54.412904 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:54.412738    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:10:55.412600 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:55.412557    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:10:55.413137 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:55.412629    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:10:56.413052 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:56.413009    2563 patch_prober.go:28] interesting pod/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:10:56.413610 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:56.413074    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:10:57.416773 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:57.416748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:57.417254 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:57.417237    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:57.417897 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:57.417872    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:10:59.366105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:59.366068    2563 patch_prober.go:28] interesting pod/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 21:10:59.366494 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:10:59.366124    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 21:11:00.443277 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.443243    2563 generic.go:356] "Generic (PLEG): container finished" podID="d851998b-f357-4ac0-b599-ab579e275abb" containerID="017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31" exitCode=0
Jul 27 21:11:00.443721 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.443320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerDied","Data":"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"}
Jul 27 21:11:00.443820 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.443805    2563 scope.go:117] "RemoveContainer" containerID="017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"
Jul 27 21:11:00.445005 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.444978    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:11:00.445075 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.445063    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:11:00.445123 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:00.445104    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:11:01.450675 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:01.450644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerStarted","Data":"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"}
Jul 27 21:11:01.732278 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:01.732190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:11:01.732432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:01.732354    2563 patch_prober.go:28] interesting pod/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:11:01.732432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:01.732404    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:11:02.732148 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:02.732110    2563 patch_prober.go:28] interesting pod/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:11:02.732551 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:02.732171    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:11:03.732430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:03.732388    2563 patch_prober.go:28] interesting pod/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:11:03.732901 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:03.732451    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:11:04.732631 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:04.732592    2563 patch_prober.go:28] interesting pod/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:11:04.733115 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:04.732650    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:11:05.735660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:05.735630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:11:05.736137 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:05.735994    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:11:05.736627 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:05.736611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:11:09.724951 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:09.724914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:11:27.961073 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:11:27.961036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:10.308297 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:10.308260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:11.243462 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:11.243428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:21.786521 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:21.786481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:21.811049 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:21.811019    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:12:21.811290 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:21.811265    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" podUID="28cef29f-474f-4dc2-9de8-20df17347918" containerName="payload-processing" containerID="cri-o://438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107" gracePeriod=30
Jul 27 21:12:21.887849 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:21.887813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:21.938949 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:21.938910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:22.069974 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.069942    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:12:22.138182 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.138154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume\") pod \"28cef29f-474f-4dc2-9de8-20df17347918\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") "
Jul 27 21:12:22.138310 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.138238    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsr67\" (UniqueName: \"kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67\") pod \"28cef29f-474f-4dc2-9de8-20df17347918\" (UID: \"28cef29f-474f-4dc2-9de8-20df17347918\") "
Jul 27 21:12:22.138506 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.138482    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28cef29f-474f-4dc2-9de8-20df17347918" (UID: "28cef29f-474f-4dc2-9de8-20df17347918"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:22.140234 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.140215    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67" (OuterVolumeSpecName: "kube-api-access-hsr67") pod "28cef29f-474f-4dc2-9de8-20df17347918" (UID: "28cef29f-474f-4dc2-9de8-20df17347918"). InnerVolumeSpecName "kube-api-access-hsr67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:22.239412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.239366    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsr67\" (UniqueName: \"kubernetes.io/projected/28cef29f-474f-4dc2-9de8-20df17347918-kube-api-access-hsr67\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.239412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.239406    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28cef29f-474f-4dc2-9de8-20df17347918-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:22.894707 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.894672    2563 generic.go:356] "Generic (PLEG): container finished" podID="28cef29f-474f-4dc2-9de8-20df17347918" containerID="438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107" exitCode=0
Jul 27 21:12:22.895166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.894716    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"
Jul 27 21:12:22.895166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.894762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" event={"ID":"28cef29f-474f-4dc2-9de8-20df17347918","Type":"ContainerDied","Data":"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"}
Jul 27 21:12:22.895166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.894812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm" event={"ID":"28cef29f-474f-4dc2-9de8-20df17347918","Type":"ContainerDied","Data":"8bf369281d26bb6a5e659d2cb209f79af3644708c0bfd66d478171110956f44a"}
Jul 27 21:12:22.895166 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.894835    2563 scope.go:117] "RemoveContainer" containerID="438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"
Jul 27 21:12:22.905061 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.905045    2563 scope.go:117] "RemoveContainer" containerID="438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"
Jul 27 21:12:22.905334 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:12:22.905313    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107\": container with ID starting with 438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107 not found: ID does not exist" containerID="438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"
Jul 27 21:12:22.905440 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.905340    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107"} err="failed to get container status \"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107\": rpc error: code = NotFound desc = could not find container \"438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107\": container with ID starting with 438ce54603c4dd8ec31c891c495d0ff4d3c0200b3409eabbfd131449086ec107 not found: ID does not exist"
Jul 27 21:12:22.916729 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.916707    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:12:22.920108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:22.920088    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-00b3a2-855b4896fd-xsnnm"]
Jul 27 21:12:23.983147 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:23.983064    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28cef29f-474f-4dc2-9de8-20df17347918" path="/var/lib/kubelet/pods/28cef29f-474f-4dc2-9de8-20df17347918/volumes"
Jul 27 21:12:26.448239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:26.448206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:26.851340 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:26.851254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:33.379869 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.379831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:33.484741 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.484697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:33.592312 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.592278    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:12:33.592562 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.592534    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy" containerID="cri-o://521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123" gracePeriod=30
Jul 27 21:12:33.615665 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.615632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:33.888491 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:33.888454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:38.849870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.849841    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:12:38.897863 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.897863 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.897863 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2k5g\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.897934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898402 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898141    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket\") pod \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\" (UID: \"286fd36a-ace7-4d28-95bc-6aab5a312fbf\") "
Jul 27 21:12:38.898402 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898289    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:12:38.898510 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898454    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.898569 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:12:38.898641 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:12:38.898697 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:12:38.898762 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.898736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data" (OuterVolumeSpecName: "istio-data") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:12:38.900191 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.900169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:12:38.900397 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.900381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:38.900483 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.900381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:12:38.900804 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.900785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g" (OuterVolumeSpecName: "kube-api-access-w2k5g") pod "286fd36a-ace7-4d28-95bc-6aab5a312fbf" (UID: "286fd36a-ace7-4d28-95bc-6aab5a312fbf"). InnerVolumeSpecName "kube-api-access-w2k5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:12:38.993245 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.993213    2563 generic.go:356] "Generic (PLEG): container finished" podID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerID="521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123" exitCode=0
Jul 27 21:12:38.993419 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.993281    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"
Jul 27 21:12:38.993419 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.993299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerDied","Data":"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"}
Jul 27 21:12:38.993419 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.993347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c" event={"ID":"286fd36a-ace7-4d28-95bc-6aab5a312fbf","Type":"ContainerDied","Data":"1c064c852024314dbe6caad9f65a68b98364703501f455de102e8d2dcb5a3921"}
Jul 27 21:12:38.993419 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.993377    2563 scope.go:117] "RemoveContainer" containerID="521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"
Jul 27 21:12:38.999201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999182    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999201    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999211    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2k5g\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-kube-api-access-w2k5g\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999220    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999228    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999236    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999244    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/286fd36a-ace7-4d28-95bc-6aab5a312fbf-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:38.999349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:38.999251    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/286fd36a-ace7-4d28-95bc-6aab5a312fbf-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:12:39.003645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.003629    2563 scope.go:117] "RemoveContainer" containerID="623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"
Jul 27 21:12:39.011716 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.011700    2563 scope.go:117] "RemoveContainer" containerID="521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"
Jul 27 21:12:39.011990 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:12:39.011949    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123\": container with ID starting with 521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123 not found: ID does not exist" containerID="521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"
Jul 27 21:12:39.012054 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.011998    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123"} err="failed to get container status \"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123\": rpc error: code = NotFound desc = could not find container \"521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123\": container with ID starting with 521b4168de9ebf2d1dd53d856f330f8807feca596915f2fbe732b914b76a6123 not found: ID does not exist"
Jul 27 21:12:39.012054 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.012015    2563 scope.go:117] "RemoveContainer" containerID="623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"
Jul 27 21:12:39.012259 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:12:39.012238    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49\": container with ID starting with 623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49 not found: ID does not exist" containerID="623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"
Jul 27 21:12:39.012319 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.012270    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49"} err="failed to get container status \"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49\": rpc error: code = NotFound desc = could not find container \"623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49\": container with ID starting with 623f47163ecd780032a2eaf5fadf706ccd5ee490518a461af1c7a6aca3b19b49 not found: ID does not exist"
Jul 27 21:12:39.020787 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.020766    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:12:39.024734 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.024714    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-00b3a2-openshift-default-85959dbb8b-4gp8c"]
Jul 27 21:12:39.983274 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:39.983243    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" path="/var/lib/kubelet/pods/286fd36a-ace7-4d28-95bc-6aab5a312fbf/volumes"
Jul 27 21:12:44.520707 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:44.520665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:46.375758 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:46.375722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:49.100558 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:49.100518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:49.519647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:49.519606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:55.575045 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:55.575004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:55.656010 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:55.655977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:55.840733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:55.840647    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:12:55.840932 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:55.840903    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy" containerID="cri-o://45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38" gracePeriod=30
Jul 27 21:12:56.007817 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.007777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.116736 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.116658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.483302 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.483267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.759385    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760300    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28cef29f-474f-4dc2-9de8-20df17347918" containerName="payload-processing"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760322    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28cef29f-474f-4dc2-9de8-20df17347918" containerName="payload-processing"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760393    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760402    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760598    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28cef29f-474f-4dc2-9de8-20df17347918" containerName="payload-processing"
Jul 27 21:12:56.762430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.760616    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="286fd36a-ace7-4d28-95bc-6aab5a312fbf" containerName="istio-proxy"
Jul 27 21:12:56.765712 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.765686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.768742 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.768720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f47ead-openshift-default-dockercfg-vs4ch\""
Jul 27 21:12:56.778318 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.778296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:12:56.785647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.785621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.866871 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.866843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.866899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.866920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlmgd\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.866952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.867002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.867020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.867037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867275 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.867062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.867275 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.867094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.893370 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.893342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:12:56.967894 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.967857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.967894 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.967900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlmgd\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.967919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.967991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968487 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968487 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968601 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968661 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968717 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.968785 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.968767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.970366 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.970344    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.970638 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.970620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.977308 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.977286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:56.978001 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:56.977954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlmgd\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd\") pod \"e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") " pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:57.079705 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:57.079645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:57.233064 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:57.232896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:12:57.235286 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:12:57.235262    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8920c486_75c8_4520_a726_b9e04076f38a.slice/crio-f424aa9859b95be1595462a52b38d1dcdfb5624ed87d0f5fd843c7ca8f499062 WatchSource:0}: Error finding container f424aa9859b95be1595462a52b38d1dcdfb5624ed87d0f5fd843c7ca8f499062: Status 404 returned error can't find the container with id f424aa9859b95be1595462a52b38d1dcdfb5624ed87d0f5fd843c7ca8f499062
Jul 27 21:12:57.237687 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:57.237647    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:12:57.237776 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:57.237734    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:12:57.237824 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:57.237775    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:12:58.097451 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:58.097415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerStarted","Data":"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"}
Jul 27 21:12:58.097855 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:58.097470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerStarted","Data":"f424aa9859b95be1595462a52b38d1dcdfb5624ed87d0f5fd843c7ca8f499062"}
Jul 27 21:12:58.120596 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:58.120541    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podStartSLOduration=2.120523843 podStartE2EDuration="2.120523843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:12:58.118752716 +0000 UTC m=+2276.723237594" watchObservedRunningTime="2026-07-27 21:12:58.120523843 +0000 UTC m=+2276.725008718"
Jul 27 21:12:59.080330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:59.080290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:59.085557 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:59.085534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:59.103473 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:59.103450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:12:59.104178 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:12:59.104162    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:00.119635 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:00.119604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:00.217125 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:00.217082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:00.346206 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:00.346172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:00.494851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:00.494791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:00.908782 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:00.908745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:01.002992 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.002930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:01.093391 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.093367    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:13:01.099267 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099245    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099386 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099278    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099386 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099532 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099424    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099532 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099640    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b88p\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099814 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099657    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:13:01.099814 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket\") pod \"d851998b-f357-4ac0-b599-ab579e275abb\" (UID: \"d851998b-f357-4ac0-b599-ab579e275abb\") "
Jul 27 21:13:01.099814 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:01.100008 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.099920    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:01.100072 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.100039    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.100072 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.100056    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.100207 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.100105    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d851998b-f357-4ac0-b599-ab579e275abb-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.100207 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.100039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data" (OuterVolumeSpecName: "istio-data") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:01.100207 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.100109    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:01.101548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.101524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:01.101647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.101615    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token" (OuterVolumeSpecName: "istio-token") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:01.101995 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.101954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:13:01.101995 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.101956    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p" (OuterVolumeSpecName: "kube-api-access-9b88p") pod "d851998b-f357-4ac0-b599-ab579e275abb" (UID: "d851998b-f357-4ac0-b599-ab579e275abb"). InnerVolumeSpecName "kube-api-access-9b88p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:01.115460 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.115433    2563 generic.go:356] "Generic (PLEG): container finished" podID="d851998b-f357-4ac0-b599-ab579e275abb" containerID="45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38" exitCode=0
Jul 27 21:13:01.115554 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.115481    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"
Jul 27 21:13:01.115554 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.115505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerDied","Data":"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"}
Jul 27 21:13:01.115554 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.115553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj" event={"ID":"d851998b-f357-4ac0-b599-ab579e275abb","Type":"ContainerDied","Data":"34b9079876035673c677616718883d6b079de5f3edcd6b95d27444909513a39a"}
Jul 27 21:13:01.115671 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.115576    2563 scope.go:117] "RemoveContainer" containerID="45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"
Jul 27 21:13:01.124896 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.124881    2563 scope.go:117] "RemoveContainer" containerID="017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"
Jul 27 21:13:01.133058 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.133041    2563 scope.go:117] "RemoveContainer" containerID="45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"
Jul 27 21:13:01.133359 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:13:01.133343    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38\": container with ID starting with 45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38 not found: ID does not exist" containerID="45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"
Jul 27 21:13:01.133435 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.133370    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38"} err="failed to get container status \"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38\": rpc error: code = NotFound desc = could not find container \"45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38\": container with ID starting with 45754cbea8bc6039c05aa7d8848c048881dc07bf7eab60d13940726e792c5e38 not found: ID does not exist"
Jul 27 21:13:01.133435 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.133394    2563 scope.go:117] "RemoveContainer" containerID="017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"
Jul 27 21:13:01.133642 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:13:01.133623    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31\": container with ID starting with 017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31 not found: ID does not exist" containerID="017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"
Jul 27 21:13:01.133681 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.133648    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31"} err="failed to get container status \"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31\": rpc error: code = NotFound desc = could not find container \"017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31\": container with ID starting with 017b199d1bf27eaa6e4c13e1d988715b3ea041d328e7676f1b0866cf7f8f8d31 not found: ID does not exist"
Jul 27 21:13:01.162526 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.162485    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:13:01.169339 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.169304    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c7d2ad-openshift-default-84ffff7bf4-9cjrj"]
Jul 27 21:13:01.194401 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194371    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:01.194803 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194789    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.194847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194804    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.194847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194813    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.194847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194818    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.194942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194888    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.194942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.194896    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d851998b-f357-4ac0-b599-ab579e275abb" containerName="istio-proxy"
Jul 27 21:13:01.198495 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.198477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.201103 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201072    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.201103 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201097    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.201362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201117    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d851998b-f357-4ac0-b599-ab579e275abb-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.201362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201132    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.201362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201149    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d851998b-f357-4ac0-b599-ab579e275abb-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.201362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.201164    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b88p\" (UniqueName: \"kubernetes.io/projected/d851998b-f357-4ac0-b599-ab579e275abb-kube-api-access-9b88p\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:01.204782 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.204757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f47ead-dockercfg-c5cwx\""
Jul 27 21:13:01.204896 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.204757    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f47ead\""
Jul 27 21:13:01.229439 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.229410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:01.302490 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.302457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.302640 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.302581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77tw\" (UniqueName: \"kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.404066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.403972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77tw\" (UniqueName: \"kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.404066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.404052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.404731 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.404710    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.416228 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.416207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77tw\" (UniqueName: \"kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw\") pod \"payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") " pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.509007 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.508946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:01.649911 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.649884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:01.651612 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:13:01.651587    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195deeec_1ffd_4e28_bde2_6366779070e5.slice/crio-4f3154148352f17cc51baed95c71f76da0ba332fefaf81e824a310643574547b WatchSource:0}: Error finding container 4f3154148352f17cc51baed95c71f76da0ba332fefaf81e824a310643574547b: Status 404 returned error can't find the container with id 4f3154148352f17cc51baed95c71f76da0ba332fefaf81e824a310643574547b
Jul 27 21:13:01.987639 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:01.987598    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d851998b-f357-4ac0-b599-ab579e275abb" path="/var/lib/kubelet/pods/d851998b-f357-4ac0-b599-ab579e275abb/volumes"
Jul 27 21:13:02.123074 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:02.123036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" event={"ID":"195deeec-1ffd-4e28-bde2-6366779070e5","Type":"ContainerStarted","Data":"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"}
Jul 27 21:13:02.123260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:02.123104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" event={"ID":"195deeec-1ffd-4e28-bde2-6366779070e5","Type":"ContainerStarted","Data":"4f3154148352f17cc51baed95c71f76da0ba332fefaf81e824a310643574547b"}
Jul 27 21:13:02.123260 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:02.123157    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:02.142020 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:02.141955    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" podStartSLOduration=1.141940476 podStartE2EDuration="1.141940476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:02.141130845 +0000 UTC m=+2280.745615744" watchObservedRunningTime="2026-07-27 21:13:02.141940476 +0000 UTC m=+2280.746425351"
Jul 27 21:13:04.657364 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:04.657327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:05.195409 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.195365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:05.412588 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.412558    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:13:05.416425 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.416405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.419027 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.419005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-965e57-openshift-default-dockercfg-5p4gl\""
Jul 27 21:13:05.429170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.429149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:13:05.439528 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439621 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cw4x\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439621 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439741 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439741 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439808 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439846 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439894 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.439948 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.439910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.448454 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.448396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:05.540430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540430 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540684 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540684 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540684 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cw4x\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540684 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.540882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.540842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.541146 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.541120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.541211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.541151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.541267 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.541224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.541267 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.541252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.542821 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.542802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.542954 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.542938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.548847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.548827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.549141 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.549120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cw4x\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x\") pod \"e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") " pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.686230 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.686195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:05.727267 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.727202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:05.875910 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.875876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:13:05.880721 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:13:05.880689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c13f7a_621d_4665_b974_b8aee6a94975.slice/crio-1387f4cc127d49e00fd912339afd0e6f18fd6995aa90353a002097c865ecc42a WatchSource:0}: Error finding container 1387f4cc127d49e00fd912339afd0e6f18fd6995aa90353a002097c865ecc42a: Status 404 returned error can't find the container with id 1387f4cc127d49e00fd912339afd0e6f18fd6995aa90353a002097c865ecc42a
Jul 27 21:13:05.883465 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.883431    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:05.883548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.883517    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:05.883601 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:05.883557    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:06.148046 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:06.147944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerStarted","Data":"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"}
Jul 27 21:13:06.148046 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:06.148025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerStarted","Data":"1387f4cc127d49e00fd912339afd0e6f18fd6995aa90353a002097c865ecc42a"}
Jul 27 21:13:06.179630 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:06.179569    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podStartSLOduration=1.179548135 podStartE2EDuration="1.179548135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:06.175726143 +0000 UTC m=+2284.780211019" watchObservedRunningTime="2026-07-27 21:13:06.179548135 +0000 UTC m=+2284.784033012"
Jul 27 21:13:06.727413 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:06.727378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:06.732528 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:06.732503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:07.153879 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:07.153797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:07.154705 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:07.154681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:08.091543 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.091486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:08.200985 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.200104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:08.291986 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.291812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:08.753727 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.753692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:08.887776 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.887706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:08.991984 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:08.990532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:12.575657 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:12.575599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:13.132056 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:13.132025    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:14.105360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.105323    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:13:14.105710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.105391    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:13:14.196942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.196865    2563 generic.go:356] "Generic (PLEG): container finished" podID="8920c486-75c8-4520-a726-b9e04076f38a" containerID="a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7" exitCode=0
Jul 27 21:13:14.197113 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.196941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerDied","Data":"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"}
Jul 27 21:13:14.197441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.197423    2563 scope.go:117] "RemoveContainer" containerID="a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"
Jul 27 21:13:14.198533 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.198502    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:14.198623 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.198572    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:14.198623 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:14.198606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:15.208544 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:15.208499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerStarted","Data":"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"}
Jul 27 21:13:16.080201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:16.080167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:16.080541 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:16.080218    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:13:16.080657 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:16.080590    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:13:17.080167 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:17.080124    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:13:17.080658 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:17.080193    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:13:18.080804 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:18.080765    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:13:18.081469 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:18.081427    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:13:19.080738 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:19.080275    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:13:19.080738 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:19.080344    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:13:20.084348 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:20.084314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:20.084812 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:20.084710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:20.085536 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:20.085515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:22.155935 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.155896    2563 patch_prober.go:28] interesting pod/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:13:22.156390 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.155957    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:13:22.259424 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.259395    2563 generic.go:356] "Generic (PLEG): container finished" podID="09c13f7a-621d-4665-b974-b8aee6a94975" containerID="31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157" exitCode=0
Jul 27 21:13:22.259593 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.259455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerDied","Data":"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"}
Jul 27 21:13:22.259808 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.259788    2563 scope.go:117] "RemoveContainer" containerID="31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"
Jul 27 21:13:22.260786 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.260758    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:22.260852 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.260835    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:22.260895 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:22.260882    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:13:23.266844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:23.266811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerStarted","Data":"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"}
Jul 27 21:13:23.727727 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:23.727687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:23.727991 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:23.727933    2563 patch_prober.go:28] interesting pod/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:13:23.728087 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:23.728042    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:13:24.728202 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:24.728165    2563 patch_prober.go:28] interesting pod/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:13:24.728582 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:24.728221    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:13:25.734634 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:25.734591    2563 patch_prober.go:28] interesting pod/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:13:25.735446 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:25.735403    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:13:26.728343 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:26.728306    2563 patch_prober.go:28] interesting pod/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:13:26.728606 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:26.728377    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:13:27.731886 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:27.731854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:27.732362 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:27.732186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:27.732778 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:27.732761    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:13:36.051517 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.051457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:36.090377 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.090347    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:36.090599 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.090572    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" podUID="195deeec-1ffd-4e28-bde2-6366779070e5" containerName="payload-processing" containerID="cri-o://a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740" gracePeriod=30
Jul 27 21:13:36.126572 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.126533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:36.226676 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.226630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:36.355934 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.355907    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:36.359174 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.359150    2563 generic.go:356] "Generic (PLEG): container finished" podID="195deeec-1ffd-4e28-bde2-6366779070e5" containerID="a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740" exitCode=0
Jul 27 21:13:36.359302 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.359198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" event={"ID":"195deeec-1ffd-4e28-bde2-6366779070e5","Type":"ContainerDied","Data":"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"}
Jul 27 21:13:36.359302 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.359216    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"
Jul 27 21:13:36.359302 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.359284    2563 scope.go:117] "RemoveContainer" containerID="a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"
Jul 27 21:13:36.359447 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.359270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5" event={"ID":"195deeec-1ffd-4e28-bde2-6366779070e5","Type":"ContainerDied","Data":"4f3154148352f17cc51baed95c71f76da0ba332fefaf81e824a310643574547b"}
Jul 27 21:13:36.367530 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.367513    2563 scope.go:117] "RemoveContainer" containerID="a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"
Jul 27 21:13:36.367781 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:13:36.367764    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740\": container with ID starting with a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740 not found: ID does not exist" containerID="a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"
Jul 27 21:13:36.367829 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.367790    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740"} err="failed to get container status \"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740\": rpc error: code = NotFound desc = could not find container \"a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740\": container with ID starting with a2aa51415778eb3f2972453b76fdce27d9e7ad895140c9eae4f082216d664740 not found: ID does not exist"
Jul 27 21:13:36.489106 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.489074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c77tw\" (UniqueName: \"kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw\") pod \"195deeec-1ffd-4e28-bde2-6366779070e5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") "
Jul 27 21:13:36.489276 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.489113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume\") pod \"195deeec-1ffd-4e28-bde2-6366779070e5\" (UID: \"195deeec-1ffd-4e28-bde2-6366779070e5\") "
Jul 27 21:13:36.489538 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.489516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "195deeec-1ffd-4e28-bde2-6366779070e5" (UID: "195deeec-1ffd-4e28-bde2-6366779070e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:13:36.491196 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.491165    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw" (OuterVolumeSpecName: "kube-api-access-c77tw") pod "195deeec-1ffd-4e28-bde2-6366779070e5" (UID: "195deeec-1ffd-4e28-bde2-6366779070e5"). InnerVolumeSpecName "kube-api-access-c77tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:36.590645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.590577    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c77tw\" (UniqueName: \"kubernetes.io/projected/195deeec-1ffd-4e28-bde2-6366779070e5-kube-api-access-c77tw\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.590645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.590602    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/195deeec-1ffd-4e28-bde2-6366779070e5-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:36.688184 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.688157    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:36.697470 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:36.697449    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f47ead-697797cfd-sd9r5"]
Jul 27 21:13:37.982723 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:37.982687    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="195deeec-1ffd-4e28-bde2-6366779070e5" path="/var/lib/kubelet/pods/195deeec-1ffd-4e28-bde2-6366779070e5/volumes"
Jul 27 21:13:40.704743 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:40.704699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:41.085220 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:41.085128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:47.153272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.153232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:47.259566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.259529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:47.411836 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.411802    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:13:47.412151 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.412121    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" containerID="cri-o://7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79" gracePeriod=30
Jul 27 21:13:47.436654 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.436630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:47.676633 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:47.676549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:13:50.087360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:50.087323    2563 patch_prober.go:28] interesting pod/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:13:50.087799 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:50.087384    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:13:52.670118 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.670092    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:52.844838 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlmgd\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.844838 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844868    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.844921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845060    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845086    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy\") pod \"8920c486-75c8-4520-a726-b9e04076f38a\" (UID: \"8920c486-75c8-4520-a726-b9e04076f38a\") "
Jul 27 21:13:52.845486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845222    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:52.845486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845236    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:52.845486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845407    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.845486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845426    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.845486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:13:52.845952 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845672    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:52.845952 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.845805    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data" (OuterVolumeSpecName: "istio-data") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:52.847097 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.847075    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd" (OuterVolumeSpecName: "kube-api-access-hlmgd") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "kube-api-access-hlmgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:52.847192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.847087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:13:52.847192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.847173    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:13:52.847292 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.847276    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8920c486-75c8-4520-a726-b9e04076f38a" (UID: "8920c486-75c8-4520-a726-b9e04076f38a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:13:52.945951 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.945899    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlmgd\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-kube-api-access-hlmgd\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.945951 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.945944    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8920c486-75c8-4520-a726-b9e04076f38a-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.945951 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.945957    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.946211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.945991    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.946211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.946000    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8920c486-75c8-4520-a726-b9e04076f38a-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.946211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.946009    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8920c486-75c8-4520-a726-b9e04076f38a-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:52.946211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:52.946016    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8920c486-75c8-4520-a726-b9e04076f38a-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:13:53.460346 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.460259    2563 generic.go:356] "Generic (PLEG): container finished" podID="8920c486-75c8-4520-a726-b9e04076f38a" containerID="7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79" exitCode=0
Jul 27 21:13:53.460346 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.460315    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"
Jul 27 21:13:53.460540 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.460355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerDied","Data":"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"}
Jul 27 21:13:53.460540 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.460423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c" event={"ID":"8920c486-75c8-4520-a726-b9e04076f38a","Type":"ContainerDied","Data":"f424aa9859b95be1595462a52b38d1dcdfb5624ed87d0f5fd843c7ca8f499062"}
Jul 27 21:13:53.460540 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.460456    2563 scope.go:117] "RemoveContainer" containerID="7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"
Jul 27 21:13:53.470388 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.470370    2563 scope.go:117] "RemoveContainer" containerID="a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"
Jul 27 21:13:53.480373 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.480354    2563 scope.go:117] "RemoveContainer" containerID="7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"
Jul 27 21:13:53.480619 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:13:53.480600    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79\": container with ID starting with 7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79 not found: ID does not exist" containerID="7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"
Jul 27 21:13:53.480685 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.480627    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79"} err="failed to get container status \"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79\": rpc error: code = NotFound desc = could not find container \"7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79\": container with ID starting with 7c0c477687529ba864693afbe441ead9ba07223e1812d456c6635fbc9fc74e79 not found: ID does not exist"
Jul 27 21:13:53.480685 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.480644    2563 scope.go:117] "RemoveContainer" containerID="a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"
Jul 27 21:13:53.480858 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:13:53.480845    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7\": container with ID starting with a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7 not found: ID does not exist" containerID="a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"
Jul 27 21:13:53.480899 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.480861    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7"} err="failed to get container status \"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7\": rpc error: code = NotFound desc = could not find container \"a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7\": container with ID starting with a8ea14db6d22e8c5de2c092947f7263a00979f47ea1fef85c90d37445c0e94a7 not found: ID does not exist"
Jul 27 21:13:53.485330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.485305    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:13:53.489691 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.489669    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f47ead-openshift-default-75d6759fd-xl96c"]
Jul 27 21:13:53.983215 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:13:53.983188    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8920c486-75c8-4520-a726-b9e04076f38a" path="/var/lib/kubelet/pods/8920c486-75c8-4520-a726-b9e04076f38a/volumes"
Jul 27 21:14:03.331938 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:03.331903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:03.406464 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:03.406427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:03.505549 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:03.505514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:07.929597 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:07.929564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:08.313138 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:08.313045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:14.387407 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.387371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:14.488733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.488691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:14.657456 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.657358    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:14:14.657627 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.657581    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy" containerID="cri-o://3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173" gracePeriod=30
Jul 27 21:14:14.684342 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.684308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:14.953847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:14.953809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:15.274355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.274247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:15.578544 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.578458    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:14:15.579024 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579006    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:15.579101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579026    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:15.579101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579059    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:15.579101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579069    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:15.579101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579091    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195deeec-1ffd-4e28-bde2-6366779070e5" containerName="payload-processing"
Jul 27 21:14:15.579101 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="195deeec-1ffd-4e28-bde2-6366779070e5" containerName="payload-processing"
Jul 27 21:14:15.579367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579213    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:15.579367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.579225    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="195deeec-1ffd-4e28-bde2-6366779070e5" containerName="payload-processing"
Jul 27 21:14:15.582067 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.582042    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.585096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.585076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-69909d-openshift-default-dockercfg-f77qg\""
Jul 27 21:14:15.593601 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.593576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:14:15.616662 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.616636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:15.646158 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646433 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646433 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcx2n\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646433 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.646433 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.646398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747628 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747827 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747827 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.747957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcx2n\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748202 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.747984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748202 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748202 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748547 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.748679 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.748663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.749920 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.749902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.750364 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.750348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.757169 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.757148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.757350 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.757331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcx2n\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n\") pod \"e2e-shared-a-69909d-openshift-default-897c9c468-t257n\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") " pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:15.893686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:15.893623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:16.038768 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.038746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:14:16.040883 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:14:16.040854    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550fb82e_9dcb_467b_bc89_fb9e366d569c.slice/crio-752d8ffcc0cb4b8df4e0e90ce18fad1d61353a33b052fc81d580b216cca15519 WatchSource:0}: Error finding container 752d8ffcc0cb4b8df4e0e90ce18fad1d61353a33b052fc81d580b216cca15519: Status 404 returned error can't find the container with id 752d8ffcc0cb4b8df4e0e90ce18fad1d61353a33b052fc81d580b216cca15519
Jul 27 21:14:16.043290 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.043245    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:16.043412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.043338    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:16.043412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.043382    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:16.291154 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.291117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:16.587895 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.587804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerStarted","Data":"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"}
Jul 27 21:14:16.587895 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.587866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerStarted","Data":"752d8ffcc0cb4b8df4e0e90ce18fad1d61353a33b052fc81d580b216cca15519"}
Jul 27 21:14:16.611561 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.611510    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podStartSLOduration=1.611495234 podStartE2EDuration="1.611495234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:16.609466481 +0000 UTC m=+2355.213951358" watchObservedRunningTime="2026-07-27 21:14:16.611495234 +0000 UTC m=+2355.215980109"
Jul 27 21:14:16.894050 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:16.893950    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:17.899671 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:17.899641    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:18.598274 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:18.598239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:18.599123 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:18.599100    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:18.615900 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:18.615869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:18.709714 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:18.709681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:18.848637 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:18.848552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:19.098719 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.098625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:19.531416 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.531376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:19.626897 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.626864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:19.915190 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.915168    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:14:19.988432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988587 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988587 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988587 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988529    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988587 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cw4x\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data\") pod \"09c13f7a-621d-4665-b974-b8aee6a94975\" (UID: \"09c13f7a-621d-4665-b974-b8aee6a94975\") "
Jul 27 21:14:19.988777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:14:19.989142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.989031    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:19.989142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.989047    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:19.989287 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.989258    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:14:19.989511 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.988950    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:14:19.989716 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.989689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data" (OuterVolumeSpecName: "istio-data") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:14:19.990824 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.990795    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token" (OuterVolumeSpecName: "istio-token") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:19.990933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.990918    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:14:19.991139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.991117    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x" (OuterVolumeSpecName: "kube-api-access-8cw4x") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "kube-api-access-8cw4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:19.991139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:19.991127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09c13f7a-621d-4665-b974-b8aee6a94975" (UID: "09c13f7a-621d-4665-b974-b8aee6a94975"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089728    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089768    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089776    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089784    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09c13f7a-621d-4665-b974-b8aee6a94975-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089792    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cw4x\" (UniqueName: \"kubernetes.io/projected/09c13f7a-621d-4665-b974-b8aee6a94975-kube-api-access-8cw4x\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089803    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09c13f7a-621d-4665-b974-b8aee6a94975-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.089810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.089812    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09c13f7a-621d-4665-b974-b8aee6a94975-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:14:20.611051 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.611011    2563 generic.go:356] "Generic (PLEG): container finished" podID="09c13f7a-621d-4665-b974-b8aee6a94975" containerID="3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173" exitCode=0
Jul 27 21:14:20.611474 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.611070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"
Jul 27 21:14:20.611474 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.611096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerDied","Data":"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"}
Jul 27 21:14:20.611474 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.611151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r" event={"ID":"09c13f7a-621d-4665-b974-b8aee6a94975","Type":"ContainerDied","Data":"1387f4cc127d49e00fd912339afd0e6f18fd6995aa90353a002097c865ecc42a"}
Jul 27 21:14:20.611474 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.611173    2563 scope.go:117] "RemoveContainer" containerID="3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"
Jul 27 21:14:20.621180 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.621162    2563 scope.go:117] "RemoveContainer" containerID="31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"
Jul 27 21:14:20.631607 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.631580    2563 scope.go:117] "RemoveContainer" containerID="3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"
Jul 27 21:14:20.631975 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:14:20.631937    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173\": container with ID starting with 3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173 not found: ID does not exist" containerID="3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"
Jul 27 21:14:20.632105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.632039    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173"} err="failed to get container status \"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173\": rpc error: code = NotFound desc = could not find container \"3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173\": container with ID starting with 3f441cdda2c995955320ae10de6ffcf80232ae48405f8a942eacd06f49e36173 not found: ID does not exist"
Jul 27 21:14:20.632105 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.632069    2563 scope.go:117] "RemoveContainer" containerID="31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"
Jul 27 21:14:20.632898 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:14:20.632871    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157\": container with ID starting with 31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157 not found: ID does not exist" containerID="31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"
Jul 27 21:14:20.633009 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.632905    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157"} err="failed to get container status \"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157\": rpc error: code = NotFound desc = could not find container \"31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157\": container with ID starting with 31140b65b59b16b1e5b911c34a265740c1b112baad1206feac01e20322ac7157 not found: ID does not exist"
Jul 27 21:14:20.635506 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.635488    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:14:20.638695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:20.638672    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-965e57-openshift-default-58f7d8dd88-wz24r"]
Jul 27 21:14:21.983670 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:21.983635    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" path="/var/lib/kubelet/pods/09c13f7a-621d-4665-b974-b8aee6a94975/volumes"
Jul 27 21:14:23.153594 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.153542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:23.485313 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.485254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:23.763993 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.763885    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:14:23.764412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.764392    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:23.764507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.764414    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:23.764507 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.764499    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8920c486-75c8-4520-a726-b9e04076f38a" containerName="istio-proxy"
Jul 27 21:14:23.764619 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.764516    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:23.764619 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.764526    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:23.767758 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.767738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.770278 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.770256    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ba2511-openshift-default-dockercfg-5m8ss\""
Jul 27 21:14:23.782140 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.782116    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:14:23.811022 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.810950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:23.823106 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823198 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823198 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823198 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlnpf\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823369 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823369 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823369 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823369 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.823506 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.823446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.902849 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.902806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:23.924905 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.924876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925041 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.924918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925041 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.924948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925041 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.924997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925041 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlnpf\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925471 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925530 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925581 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.925734 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.925717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.927332 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.927309    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.927548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.927530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.934366 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.934337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:23.934510 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:23.934486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlnpf\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf\") pod \"e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") " pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:24.079756 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.079662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:24.220448 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.220414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:14:24.222295 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:14:24.222270    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240bc724_526e_4424_9a09_a4762e714794.slice/crio-5c8170180552b62dad6e01eb1b3e096ee7ccbb56a925438bf01c197fcb55e303 WatchSource:0}: Error finding container 5c8170180552b62dad6e01eb1b3e096ee7ccbb56a925438bf01c197fcb55e303: Status 404 returned error can't find the container with id 5c8170180552b62dad6e01eb1b3e096ee7ccbb56a925438bf01c197fcb55e303
Jul 27 21:14:24.224557 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.224519    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:24.224638 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.224606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:24.224684 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.224646    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:24.637079 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.637044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerStarted","Data":"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"}
Jul 27 21:14:24.637264 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.637103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerStarted","Data":"5c8170180552b62dad6e01eb1b3e096ee7ccbb56a925438bf01c197fcb55e303"}
Jul 27 21:14:24.664270 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:24.664219    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podStartSLOduration=1.664203701 podStartE2EDuration="1.664203701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:24.661879529 +0000 UTC m=+2363.266364405" watchObservedRunningTime="2026-07-27 21:14:24.664203701 +0000 UTC m=+2363.268688575"
Jul 27 21:14:25.080525 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:25.080485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:25.086024 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:25.085998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:25.644235 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:25.644203    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:25.645197 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:25.645176    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:26.723808 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:26.723713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:26.808690 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:26.808647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:26.899981 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:26.899934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:27.427215 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.427176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:27.522947 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.522867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:27.545973 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.545928    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:14:27.546321 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.546307    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:27.546321 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.546322    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c13f7a-621d-4665-b974-b8aee6a94975" containerName="istio-proxy"
Jul 27 21:14:27.549102 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.549079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.551477 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.551378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ba2511-dockercfg-p7j48\""
Jul 27 21:14:27.551477 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.551409    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ba2511\""
Jul 27 21:14:27.561693 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.561667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:14:27.661244 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.661202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.661392 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.661254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7pn\" (UniqueName: \"kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.752481 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.752446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:27.762887 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.762857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.763064 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.763015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7pn\" (UniqueName: \"kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.763595 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.763575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.791439 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.791366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7pn\" (UniqueName: \"kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn\") pod \"payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:27.863211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:27.863181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:28.055293 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:28.055268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:14:28.056694 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:14:28.056666    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e59dd1_7b26_4509_b0de_0aecea375c25.slice/crio-bad7356b2ba86bbdee83cdd10e5dd448296eff077931140aa5683349a99450db WatchSource:0}: Error finding container bad7356b2ba86bbdee83cdd10e5dd448296eff077931140aa5683349a99450db: Status 404 returned error can't find the container with id bad7356b2ba86bbdee83cdd10e5dd448296eff077931140aa5683349a99450db
Jul 27 21:14:28.662234 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:28.662193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" event={"ID":"e4e59dd1-7b26-4509-b0de-0aecea375c25","Type":"ContainerStarted","Data":"9fe7e95b7a1d40e085d41aa74f55d94194d931537463a6e92de767a0d1ab1821"}
Jul 27 21:14:28.662395 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:28.662288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" event={"ID":"e4e59dd1-7b26-4509-b0de-0aecea375c25","Type":"ContainerStarted","Data":"bad7356b2ba86bbdee83cdd10e5dd448296eff077931140aa5683349a99450db"}
Jul 27 21:14:28.662395 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:28.662313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:28.686389 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:28.686327    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" podStartSLOduration=1.686307453 podStartE2EDuration="1.686307453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:28.683050589 +0000 UTC m=+2367.287535466" watchObservedRunningTime="2026-07-27 21:14:28.686307453 +0000 UTC m=+2367.290792332"
Jul 27 21:14:31.242298 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:31.242265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:32.692596 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.692552    2563 generic.go:356] "Generic (PLEG): container finished" podID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerID="fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e" exitCode=0
Jul 27 21:14:32.693191 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.692652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerDied","Data":"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"}
Jul 27 21:14:32.693191 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.693184    2563 scope.go:117] "RemoveContainer" containerID="fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"
Jul 27 21:14:32.697426 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.694705    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:32.697426 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.694797    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:32.697426 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:32.694840    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:33.598424 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.598383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:33.628703 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.628615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:33.704264 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.704228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerStarted","Data":"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"}
Jul 27 21:14:33.894335 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.894238    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:33.895521 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.895484    2563 patch_prober.go:28] interesting pod/e2e-shared-a-69909d-openshift-default-897c9c468-t257n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 27 21:14:33.895660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:33.895567    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 27 21:14:34.895213 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:34.895163    2563 patch_prober.go:28] interesting pod/e2e-shared-a-69909d-openshift-default-897c9c468-t257n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 27 21:14:34.895727 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:34.895237    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 27 21:14:35.894360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:35.894315    2563 patch_prober.go:28] interesting pod/e2e-shared-a-69909d-openshift-default-897c9c468-t257n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 27 21:14:35.894576 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:35.894400    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 27 21:14:36.894627 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:36.894576    2563 patch_prober.go:28] interesting pod/e2e-shared-a-69909d-openshift-default-897c9c468-t257n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 27 21:14:36.895162 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:36.894652    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 27 21:14:37.899164 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:37.899134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:37.899566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:37.899395    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:37.900241 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:37.900225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:14:39.670549 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.670520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:14:39.745234 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.745203    2563 generic.go:356] "Generic (PLEG): container finished" podID="240bc724-526e-4424-9a09-a4762e714794" containerID="7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69" exitCode=0
Jul 27 21:14:39.745390 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.745274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerDied","Data":"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"}
Jul 27 21:14:39.745672 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.745661    2563 scope.go:117] "RemoveContainer" containerID="7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"
Jul 27 21:14:39.746611 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.746586    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:39.746664 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.746646    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:39.746699 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:39.746676    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:14:40.645042 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:40.645008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:40.752618 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:40.752581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerStarted","Data":"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"}
Jul 27 21:14:41.080664 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:41.080629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:41.082066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:41.082034    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:14:41.082306 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:41.082273    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:14:42.080203 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:42.080165    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:14:42.080838 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:42.080804    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:14:43.080888 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:43.080848    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:14:43.081524 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:43.081494    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:14:44.080163 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:44.080123    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:14:44.080476 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:44.080445    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:14:45.083929 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:45.083896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:45.084394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:45.084228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:45.084948 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:45.084932    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:14:45.221317 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:45.221281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:14:59.818455 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:14:59.818404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:15:03.280142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:15:03.280104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:16:28.791998 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:16:28.791938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:17:20.674848 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:17:20.674759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:19:18.510347 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:18.510307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:19:19.784092 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:19.784056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:19:28.271220 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.271191    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:19:28.274687 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.274665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.279710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.279677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-69909d\"/\"kube-root-ca.crt\""
Jul 27 21:19:28.279858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.279718    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-69909d\"/\"sub-test-model-69909d-kserve-self-signed-certs\""
Jul 27 21:19:28.279858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.279741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-69909d\"/\"openshift-service-ca.crt\""
Jul 27 21:19:28.279858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.279760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-69909d\"/\"default-dockercfg-lwsxj\""
Jul 27 21:19:28.291163 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.291138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:19:28.304829 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.304773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:19:28.343384 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d64hb\" (UniqueName: \"kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.343523 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.343523 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.343600 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.343647 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.343691 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.343672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444494 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444613 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444669 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444708 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444751 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d64hb\" (UniqueName: \"kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444803 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444863 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.444920 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.444886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.445050 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.445030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.446743 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.446718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.447159 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.447139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.454542 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.454514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d64hb\" (UniqueName: \"kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb\") pod \"sub-test-model-69909d-kserve-78b6f6f5c7-g62vv\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") " pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.584617 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.584552    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:28.731721 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:28.731557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:19:28.734341 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:19:28.734314    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7f7faa_62a9_4423_a02b_bc9c085e5301.slice/crio-775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f WatchSource:0}: Error finding container 775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f: Status 404 returned error can't find the container with id 775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f
Jul 27 21:19:29.359577 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:29.359542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" event={"ID":"fe7f7faa-62a9-4423-a02b-bc9c085e5301","Type":"ContainerStarted","Data":"5d52e2c294799c09e6f2a7e9e5f4dd0134727e2a2c8b7c175bee286517354700"}
Jul 27 21:19:29.360089 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:29.359583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" event={"ID":"fe7f7faa-62a9-4423-a02b-bc9c085e5301","Type":"ContainerStarted","Data":"775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f"}
Jul 27 21:19:29.385372 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:29.385322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" podStartSLOduration=1.385306379 podStartE2EDuration="1.385306379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:19:29.382917731 +0000 UTC m=+2667.987402607" watchObservedRunningTime="2026-07-27 21:19:29.385306379 +0000 UTC m=+2667.989791255"
Jul 27 21:19:38.585367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:38.585331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:38.585367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:38.585374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:38.597750 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:38.597727    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:39.425576 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:39.425550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:19:56.272716 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:19:56.272638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:20:53.749171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:20:53.749139    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:20:53.769171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:20:53.769142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:20:54.737857 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:20:54.737828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:20:59.791239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:20:59.791201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:20:59.866737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:20:59.866703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:21:03.063955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:03.063921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:21:08.768213 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:08.768175    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" podUID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" containerName="main" containerID="cri-o://5d52e2c294799c09e6f2a7e9e5f4dd0134727e2a2c8b7c175bee286517354700" gracePeriod=45
Jul 27 21:21:08.908251 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:08.908223    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" containerID="5d52e2c294799c09e6f2a7e9e5f4dd0134727e2a2c8b7c175bee286517354700" exitCode=0
Jul 27 21:21:08.908394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:08.908300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" event={"ID":"fe7f7faa-62a9-4423-a02b-bc9c085e5301","Type":"ContainerDied","Data":"5d52e2c294799c09e6f2a7e9e5f4dd0134727e2a2c8b7c175bee286517354700"}
Jul 27 21:21:09.024888 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.024832    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:21:09.077343 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077514 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077514 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077436    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077514 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077514 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077509    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d64hb\" (UniqueName: \"kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir\") pod \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\" (UID: \"fe7f7faa-62a9-4423-a02b-bc9c085e5301\") "
Jul 27 21:21:09.077730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077586    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:21:09.077829 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.077808    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-model-cache\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.078050 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.078029    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home" (OuterVolumeSpecName: "home") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:21:09.078366 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.078345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:21:09.080223 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.080179    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm" (OuterVolumeSpecName: "dshm") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:21:09.080414 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.080391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:21:09.080414 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.080406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb" (OuterVolumeSpecName: "kube-api-access-d64hb") pod "fe7f7faa-62a9-4423-a02b-bc9c085e5301" (UID: "fe7f7faa-62a9-4423-a02b-bc9c085e5301"). InnerVolumeSpecName "kube-api-access-d64hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:21:09.178479 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.178455    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-home\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.178479 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.178477    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tls-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.178668 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.178486    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-dshm\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.178668 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.178495    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d64hb\" (UniqueName: \"kubernetes.io/projected/fe7f7faa-62a9-4423-a02b-bc9c085e5301-kube-api-access-d64hb\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.178668 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.178503    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe7f7faa-62a9-4423-a02b-bc9c085e5301-tmp-dir\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:21:09.914701 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.914674    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"
Jul 27 21:21:09.915150 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.914711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv" event={"ID":"fe7f7faa-62a9-4423-a02b-bc9c085e5301","Type":"ContainerDied","Data":"775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f"}
Jul 27 21:21:09.915150 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.914775    2563 scope.go:117] "RemoveContainer" containerID="5d52e2c294799c09e6f2a7e9e5f4dd0134727e2a2c8b7c175bee286517354700"
Jul 27 21:21:09.936535 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:21:09.936507    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7f7faa_62a9_4423_a02b_bc9c085e5301.slice/crio-775c96ebc3f431fd9c323efa90c361237e91fe10c84b3ba25a7facc219a2968f\": RecentStats: unable to find data in memory cache]"
Jul 27 21:21:09.938089 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.938068    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:21:09.941434 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.941407    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-69909d/sub-test-model-69909d-kserve-78b6f6f5c7-g62vv"]
Jul 27 21:21:09.983614 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:09.983587    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" path="/var/lib/kubelet/pods/fe7f7faa-62a9-4423-a02b-bc9c085e5301/volumes"
Jul 27 21:21:12.151197 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:12.151160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:21:27.162884 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:21:27.162800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:36.571663 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:36.571601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:37.378450 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:37.378386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:47.881855 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.881825    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7706-139641636775808"]
Jul 27 21:22:47.882324 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.882211    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" containerName="main"
Jul 27 21:22:47.882324 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.882223    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" containerName="main"
Jul 27 21:22:47.882324 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.882290    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe7f7faa-62a9-4423-a02b-bc9c085e5301" containerName="main"
Jul 27 21:22:47.885271 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.885253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:47.888036 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.888010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p9zrj\""
Jul 27 21:22:47.894521 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.890429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-139641636775808"]
Jul 27 21:22:47.992355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:47.992325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tnfv\" (UniqueName: \"kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv\") pod \"test-curl-7706-139641636775808\" (UID: \"ac834dc2-ba52-4c71-9fba-f982e58a9700\") " pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:48.093732 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.093697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tnfv\" (UniqueName: \"kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv\") pod \"test-curl-7706-139641636775808\" (UID: \"ac834dc2-ba52-4c71-9fba-f982e58a9700\") " pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:48.102173 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.102148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tnfv\" (UniqueName: \"kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv\") pod \"test-curl-7706-139641636775808\" (UID: \"ac834dc2-ba52-4c71-9fba-f982e58a9700\") " pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:48.203579 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.203550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:48.340541 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.340516    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-139641636775808"]
Jul 27 21:22:48.342747 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:22:48.342713    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac834dc2_ba52_4c71_9fba_f982e58a9700.slice/crio-dac9193083c59bd6d140f10c90f3185e94cea6428489f21c79aeca883a90021a WatchSource:0}: Error finding container dac9193083c59bd6d140f10c90f3185e94cea6428489f21c79aeca883a90021a: Status 404 returned error can't find the container with id dac9193083c59bd6d140f10c90f3185e94cea6428489f21c79aeca883a90021a
Jul 27 21:22:48.344256 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.344236    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:22:48.452331 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:48.452300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-139641636775808" event={"ID":"ac834dc2-ba52-4c71-9fba-f982e58a9700","Type":"ContainerStarted","Data":"dac9193083c59bd6d140f10c90f3185e94cea6428489f21c79aeca883a90021a"}
Jul 27 21:22:49.459029 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:49.458994    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac834dc2-ba52-4c71-9fba-f982e58a9700" containerID="d1bb91bbb1c66b465811b56e016d99c020d8177b7a233fd3dc4523ef077945cb" exitCode=0
Jul 27 21:22:49.459404 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:49.459085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-139641636775808" event={"ID":"ac834dc2-ba52-4c71-9fba-f982e58a9700","Type":"ContainerDied","Data":"d1bb91bbb1c66b465811b56e016d99c020d8177b7a233fd3dc4523ef077945cb"}
Jul 27 21:22:50.595655 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.595631    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:50.616192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.616167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7706-139641636775808_ac834dc2-ba52-4c71-9fba-f982e58a9700/test-curl-7706-139641636775808/0.log"
Jul 27 21:22:50.639155 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.639132    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7706-139641636775808"]
Jul 27 21:22:50.644096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.644069    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7706-139641636775808"]
Jul 27 21:22:50.718470 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.718409    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tnfv\" (UniqueName: \"kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv\") pod \"ac834dc2-ba52-4c71-9fba-f982e58a9700\" (UID: \"ac834dc2-ba52-4c71-9fba-f982e58a9700\") "
Jul 27 21:22:50.720559 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.720531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv" (OuterVolumeSpecName: "kube-api-access-8tnfv") pod "ac834dc2-ba52-4c71-9fba-f982e58a9700" (UID: "ac834dc2-ba52-4c71-9fba-f982e58a9700"). InnerVolumeSpecName "kube-api-access-8tnfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:22:50.770929 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.770904    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7706-139641640572512"]
Jul 27 21:22:50.771353 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.771327    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" containerName="test-curl-7706-139641636775808"
Jul 27 21:22:50.771353 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.771345    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" containerName="test-curl-7706-139641636775808"
Jul 27 21:22:50.771527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.771405    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" containerName="test-curl-7706-139641636775808"
Jul 27 21:22:50.774493 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.774478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:50.778868 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.778845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-139641640572512"]
Jul 27 21:22:50.820024 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.820000    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tnfv\" (UniqueName: \"kubernetes.io/projected/ac834dc2-ba52-4c71-9fba-f982e58a9700-kube-api-access-8tnfv\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:22:50.920469 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:50.920432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8ws\" (UniqueName: \"kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws\") pod \"test-curl-7706-139641640572512\" (UID: \"89dd2347-1dd8-44fe-8a0d-ed58eee8b090\") " pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:51.021535 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.021449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8ws\" (UniqueName: \"kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws\") pod \"test-curl-7706-139641640572512\" (UID: \"89dd2347-1dd8-44fe-8a0d-ed58eee8b090\") " pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:51.029201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.029177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8ws\" (UniqueName: \"kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws\") pod \"test-curl-7706-139641640572512\" (UID: \"89dd2347-1dd8-44fe-8a0d-ed58eee8b090\") " pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:51.085427 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.085394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:51.226920 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.226898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7706-139641640572512"]
Jul 27 21:22:51.228896 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:22:51.228871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89dd2347_1dd8_44fe_8a0d_ed58eee8b090.slice/crio-705b9df60b4dc37d66aa14fdc698527f14b377fdebd6133345bde51b4c069c23 WatchSource:0}: Error finding container 705b9df60b4dc37d66aa14fdc698527f14b377fdebd6133345bde51b4c069c23: Status 404 returned error can't find the container with id 705b9df60b4dc37d66aa14fdc698527f14b377fdebd6133345bde51b4c069c23
Jul 27 21:22:51.470571 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.470535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-139641640572512" event={"ID":"89dd2347-1dd8-44fe-8a0d-ed58eee8b090","Type":"ContainerStarted","Data":"705b9df60b4dc37d66aa14fdc698527f14b377fdebd6133345bde51b4c069c23"}
Jul 27 21:22:51.471737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.471716    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dac9193083c59bd6d140f10c90f3185e94cea6428489f21c79aeca883a90021a"
Jul 27 21:22:51.471737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.471717    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:51.484712 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:22:51.484687    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7706-139641636775808\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:51.981515 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:22:51.981484    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7706-139641636775808\" is forbidden: User \"system:node:ip-10-0-140-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-195.ec2.internal' and this object" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" pod="opendatahub/test-curl-7706-139641636775808"
Jul 27 21:22:51.984117 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:51.984096    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac834dc2-ba52-4c71-9fba-f982e58a9700" path="/var/lib/kubelet/pods/ac834dc2-ba52-4c71-9fba-f982e58a9700/volumes"
Jul 27 21:22:52.480366 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:52.480330    2563 generic.go:356] "Generic (PLEG): container finished" podID="89dd2347-1dd8-44fe-8a0d-ed58eee8b090" containerID="ded0ec51962d33fb085300cf1ece7a8dc01560a45f07ffe2766351aac3a509ae" exitCode=0
Jul 27 21:22:52.480568 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:52.480374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7706-139641640572512" event={"ID":"89dd2347-1dd8-44fe-8a0d-ed58eee8b090","Type":"ContainerDied","Data":"ded0ec51962d33fb085300cf1ece7a8dc01560a45f07ffe2766351aac3a509ae"}
Jul 27 21:22:53.622156 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.622128    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:53.641141 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.641109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7706-139641640572512_89dd2347-1dd8-44fe-8a0d-ed58eee8b090/test-curl-7706-139641640572512/0.log"
Jul 27 21:22:53.665007 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.664951    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7706-139641640572512"]
Jul 27 21:22:53.667253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.667232    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7706-139641640572512"]
Jul 27 21:22:53.748993 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.748873    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8ws\" (UniqueName: \"kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws\") pod \"89dd2347-1dd8-44fe-8a0d-ed58eee8b090\" (UID: \"89dd2347-1dd8-44fe-8a0d-ed58eee8b090\") "
Jul 27 21:22:53.750909 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.750886    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws" (OuterVolumeSpecName: "kube-api-access-mz8ws") pod "89dd2347-1dd8-44fe-8a0d-ed58eee8b090" (UID: "89dd2347-1dd8-44fe-8a0d-ed58eee8b090"). InnerVolumeSpecName "kube-api-access-mz8ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:22:53.849939 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.849898    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8ws\" (UniqueName: \"kubernetes.io/projected/89dd2347-1dd8-44fe-8a0d-ed58eee8b090-kube-api-access-mz8ws\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:22:53.984305 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:53.984273    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89dd2347-1dd8-44fe-8a0d-ed58eee8b090" path="/var/lib/kubelet/pods/89dd2347-1dd8-44fe-8a0d-ed58eee8b090/volumes"
Jul 27 21:22:54.494186 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:54.494159    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7706-139641640572512"
Jul 27 21:22:54.494367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:54.494203    2563 scope.go:117] "RemoveContainer" containerID="ded0ec51962d33fb085300cf1ece7a8dc01560a45f07ffe2766351aac3a509ae"
Jul 27 21:22:57.330699 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.330667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:57.660211 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.660183    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:22:57.660575 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.660563    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89dd2347-1dd8-44fe-8a0d-ed58eee8b090" containerName="test-curl-7706-139641640572512"
Jul 27 21:22:57.660617 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.660577    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="89dd2347-1dd8-44fe-8a0d-ed58eee8b090" containerName="test-curl-7706-139641640572512"
Jul 27 21:22:57.660660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.660643    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="89dd2347-1dd8-44fe-8a0d-ed58eee8b090" containerName="test-curl-7706-139641640572512"
Jul 27 21:22:57.665224 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.665204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.668619 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.668603    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-91a310-openshift-default-dockercfg-rjlnx\""
Jul 27 21:22:57.682632 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.682604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:22:57.691784 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.691760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:57.787791 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.787913 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.787913 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.787913 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.787913 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.788095 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.787947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.788095 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.788004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.788095 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.788022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.788095 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.788068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwcq\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.797259 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.797234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:22:57.888757 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwcq\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.888955 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.888956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889327 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889327 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889440 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889754 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889814 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.889924 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.889902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.891262 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.891233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.891477 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.891460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.896814 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.896788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.896908 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.896869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwcq\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq\") pod \"e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") " pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:57.980112 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:57.980032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:58.118451 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.118421    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:22:58.119915 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:22:58.119889    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bbe06f_2bd4_46b6_ab7c_5aeef3d8dc41.slice/crio-cd2da5cbc3c689844b235e5c976fe903df0c82f9cad7e16e645cabf0acc331de WatchSource:0}: Error finding container cd2da5cbc3c689844b235e5c976fe903df0c82f9cad7e16e645cabf0acc331de: Status 404 returned error can't find the container with id cd2da5cbc3c689844b235e5c976fe903df0c82f9cad7e16e645cabf0acc331de
Jul 27 21:22:58.122196 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.122164    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:22:58.122257 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.122229    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:22:58.122299 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.122259    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:22:58.517784 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.517746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerStarted","Data":"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"}
Jul 27 21:22:58.518191 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.517808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerStarted","Data":"cd2da5cbc3c689844b235e5c976fe903df0c82f9cad7e16e645cabf0acc331de"}
Jul 27 21:22:58.539225 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.539175    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podStartSLOduration=1.539159062 podStartE2EDuration="1.539159062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:22:58.538075741 +0000 UTC m=+2877.142560619" watchObservedRunningTime="2026-07-27 21:22:58.539159062 +0000 UTC m=+2877.143643937"
Jul 27 21:22:58.980382 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:58.980350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:22:59.986434 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:22:59.986403    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:00.529409 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.529379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:00.530388 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.530369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:00.551277 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.551246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:00.646349 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.646306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:00.762587 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.762551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:00.865720 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:00.865618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:01.352623 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:01.352588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:01.446315 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:01.446284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:05.088003 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:05.087972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:16.037942 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.037902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:16.382499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.382461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:16.401917 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.401573    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:33974->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Jul 27 21:23:16.401917 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.401634    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:33974->10.133.0.72:15021: read: connection reset by peer"
Jul 27 21:23:16.539691 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.539646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:16.630615 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.630543    2563 generic.go:356] "Generic (PLEG): container finished" podID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerID="fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc" exitCode=0
Jul 27 21:23:16.630615 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.630591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerDied","Data":"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"}
Jul 27 21:23:16.630988 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.630972    2563 scope.go:117] "RemoveContainer" containerID="fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"
Jul 27 21:23:16.632064 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.632033    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:23:16.632176 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.632117    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:23:16.632176 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:16.632164    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 27 21:23:17.638651 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:17.638618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerStarted","Data":"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"}
Jul 27 21:23:17.981565 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:17.981522    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:23:17.981781 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:17.981595    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 27 21:23:17.991120 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:17.991084    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:18.101156 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:18.101112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:18.165643 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:18.165612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:18.981416 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:18.981379    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:23:18.982132 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:18.982104    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 27 21:23:19.981626 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:19.981585    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:23:19.982400 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:19.982277    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 27 21:23:20.980609 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:20.980567    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 27 21:23:20.980918 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:20.980888    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 27 21:23:21.984249 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:21.984217    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:21.984713 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:21.984466    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:21.985090 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:21.985072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:23:22.776355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:22.776321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:22.959193 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:22.959165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:23.181315 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:23.181258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:23.334427 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:23.334393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:23.937927 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:23.937890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:24.030858 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:24.030828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:27.239171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:27.239140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:23:44.579066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:23:44.579035    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"
Jul 27 21:24:05.472351 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:05.472318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:25.225685 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:25.225612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:38.933368 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:38.933335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:47.240585 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:47.240557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"
Jul 27 21:24:47.658418 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:47.658332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:47.997693 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:47.997606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:48.142640 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:48.142605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:51.260162 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:51.260130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:51.344253 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:51.344223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:51.420901 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:51.420866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:51.528668 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:51.528572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:52.113411 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.113365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:52.213096 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.213059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:24:52.304486 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.304450    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:24:52.307575 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.307556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.309937 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.309920    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-baf2d2\""
Jul 27 21:24:52.310045 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.310003    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-baf2d2-dockercfg-5k8gl\""
Jul 27 21:24:52.318171 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.318148    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:24:52.369337 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.369227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptstw\" (UniqueName: \"kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.369512 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.369384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.470220 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.470185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptstw\" (UniqueName: \"kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.470406 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.470264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.470913 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.470893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.479226 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.479198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptstw\" (UniqueName: \"kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw\") pod \"payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.619083 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.619054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:52.772645 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:52.772616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:24:52.774957 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:24:52.774921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcb1b3d_5d8c_4258_97d1_076badeec011.slice/crio-a61d14247782884af7de851c2028e9cb7984356fa4bbc1552f803d6ea48b7168 WatchSource:0}: Error finding container a61d14247782884af7de851c2028e9cb7984356fa4bbc1552f803d6ea48b7168: Status 404 returned error can't find the container with id a61d14247782884af7de851c2028e9cb7984356fa4bbc1552f803d6ea48b7168
Jul 27 21:24:53.165527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:53.165489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" event={"ID":"ffcb1b3d-5d8c-4258-97d1-076badeec011","Type":"ContainerStarted","Data":"6b0ba5376ab669115dce747bd48f2978b73dcef08551e6660bce859b5faebe5a"}
Jul 27 21:24:53.165710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:53.165549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" event={"ID":"ffcb1b3d-5d8c-4258-97d1-076badeec011","Type":"ContainerStarted","Data":"a61d14247782884af7de851c2028e9cb7984356fa4bbc1552f803d6ea48b7168"}
Jul 27 21:24:53.165710 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:53.165703    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:24:53.192399 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:53.192352    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" podStartSLOduration=1.192335864 podStartE2EDuration="1.192335864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:24:53.191100029 +0000 UTC m=+2991.795584904" watchObservedRunningTime="2026-07-27 21:24:53.192335864 +0000 UTC m=+2991.796820738"
Jul 27 21:24:55.693898 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:24:55.693865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:04.173391 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:04.173357    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:25:17.089242 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.089206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:17.128804 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.128770    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:25:17.129066 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.129040    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" podUID="ffcb1b3d-5d8c-4258-97d1-076badeec011" containerName="payload-pre-processing" containerID="cri-o://6b0ba5376ab669115dce747bd48f2978b73dcef08551e6660bce859b5faebe5a" gracePeriod=30
Jul 27 21:25:17.193998 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.193954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:17.291495 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.291457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:17.311367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.308358    2563 generic.go:356] "Generic (PLEG): container finished" podID="ffcb1b3d-5d8c-4258-97d1-076badeec011" containerID="6b0ba5376ab669115dce747bd48f2978b73dcef08551e6660bce859b5faebe5a" exitCode=0
Jul 27 21:25:17.311367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.308485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" event={"ID":"ffcb1b3d-5d8c-4258-97d1-076badeec011","Type":"ContainerDied","Data":"6b0ba5376ab669115dce747bd48f2978b73dcef08551e6660bce859b5faebe5a"}
Jul 27 21:25:17.397509 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.397484    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:25:17.508404 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.508369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptstw\" (UniqueName: \"kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw\") pod \"ffcb1b3d-5d8c-4258-97d1-076badeec011\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") "
Jul 27 21:25:17.508600 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.508416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume\") pod \"ffcb1b3d-5d8c-4258-97d1-076badeec011\" (UID: \"ffcb1b3d-5d8c-4258-97d1-076badeec011\") "
Jul 27 21:25:17.508888 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.508859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffcb1b3d-5d8c-4258-97d1-076badeec011" (UID: "ffcb1b3d-5d8c-4258-97d1-076badeec011"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:17.510501 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.510479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw" (OuterVolumeSpecName: "kube-api-access-ptstw") pod "ffcb1b3d-5d8c-4258-97d1-076badeec011" (UID: "ffcb1b3d-5d8c-4258-97d1-076badeec011"). InnerVolumeSpecName "kube-api-access-ptstw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:17.609285 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.609251    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptstw\" (UniqueName: \"kubernetes.io/projected/ffcb1b3d-5d8c-4258-97d1-076badeec011-kube-api-access-ptstw\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:25:17.609285 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:17.609280    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcb1b3d-5d8c-4258-97d1-076badeec011-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:25:18.315586 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:18.315504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"
Jul 27 21:25:18.315586 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:18.315547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57" event={"ID":"ffcb1b3d-5d8c-4258-97d1-076badeec011","Type":"ContainerDied","Data":"a61d14247782884af7de851c2028e9cb7984356fa4bbc1552f803d6ea48b7168"}
Jul 27 21:25:18.316193 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:18.315618    2563 scope.go:117] "RemoveContainer" containerID="6b0ba5376ab669115dce747bd48f2978b73dcef08551e6660bce859b5faebe5a"
Jul 27 21:25:18.337527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:18.337500    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:25:18.341394 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:18.341373    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-baf2d2-76c889f77b-hkr57"]
Jul 27 21:25:19.983484 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:19.983447    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffcb1b3d-5d8c-4258-97d1-076badeec011" path="/var/lib/kubelet/pods/ffcb1b3d-5d8c-4258-97d1-076badeec011/volumes"
Jul 27 21:25:21.720911 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:21.720870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:22.104599 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:22.104503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:28.217239 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:28.217201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:28.325518 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:28.325482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:28.516279 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:28.516204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:28.753914 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:28.753880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:32.156723 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.156690    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"]
Jul 27 21:25:32.157117 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.157107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcb1b3d-5d8c-4258-97d1-076badeec011" containerName="payload-pre-processing"
Jul 27 21:25:32.157117 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.157118    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcb1b3d-5d8c-4258-97d1-076badeec011" containerName="payload-pre-processing"
Jul 27 21:25:32.157233 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.157222    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcb1b3d-5d8c-4258-97d1-076badeec011" containerName="payload-pre-processing"
Jul 27 21:25:32.161737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.161722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:32.164769 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.164746    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2vhj\""
Jul 27 21:25:32.165660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.165638    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:25:32.184321 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.184297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"]
Jul 27 21:25:32.251653 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.251622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-91a310-sn948\" (UID: \"370404c5-487e-43b3-b6bb-50cb50d0f59c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:32.353110 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.353062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-91a310-sn948\" (UID: \"370404c5-487e-43b3-b6bb-50cb50d0f59c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:32.353766 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.353746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-91a310-sn948\" (UID: \"370404c5-487e-43b3-b6bb-50cb50d0f59c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:32.471787 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.471752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:32.612441 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:32.611807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"]
Jul 27 21:25:33.408246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:33.408203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948" event={"ID":"370404c5-487e-43b3-b6bb-50cb50d0f59c","Type":"ContainerStarted","Data":"7a432cd885b9c3f99c44fe319e89cb47dbce0539100207ba9595f08533c92164"}
Jul 27 21:25:35.422735 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:35.422700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948" event={"ID":"370404c5-487e-43b3-b6bb-50cb50d0f59c","Type":"ContainerStarted","Data":"22b2fd140ce9668b2f407587a3e45b67f00b83222b04e0641bc82588601f6593"}
Jul 27 21:25:35.439851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:35.439800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948" podStartSLOduration=1.077024602 podStartE2EDuration="3.439785004s" totalImagesPullingTime="2.362760402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:25:35.437951342 +0000 UTC m=+3034.042436218" watchObservedRunningTime="2026-07-27 21:25:35.439785004 +0000 UTC m=+3034.044269878"
Jul 27 21:25:36.429799 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:36.429763    2563 generic.go:356] "Generic (PLEG): container finished" podID="370404c5-487e-43b3-b6bb-50cb50d0f59c" containerID="22b2fd140ce9668b2f407587a3e45b67f00b83222b04e0641bc82588601f6593" exitCode=0
Jul 27 21:25:36.430217 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:36.429836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948" event={"ID":"370404c5-487e-43b3-b6bb-50cb50d0f59c","Type":"ContainerDied","Data":"22b2fd140ce9668b2f407587a3e45b67f00b83222b04e0641bc82588601f6593"}
Jul 27 21:25:37.574292 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:37.574269    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:37.705620 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:37.705537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca\") pod \"370404c5-487e-43b3-b6bb-50cb50d0f59c\" (UID: \"370404c5-487e-43b3-b6bb-50cb50d0f59c\") "
Jul 27 21:25:37.705927 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:37.705906    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "370404c5-487e-43b3-b6bb-50cb50d0f59c" (UID: "370404c5-487e-43b3-b6bb-50cb50d0f59c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:25:37.807183 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:37.807151    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/370404c5-487e-43b3-b6bb-50cb50d0f59c-maas-api-service-ca\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:25:38.442417 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:38.442390    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"
Jul 27 21:25:38.442417 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:38.442399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948" event={"ID":"370404c5-487e-43b3-b6bb-50cb50d0f59c","Type":"ContainerDied","Data":"7a432cd885b9c3f99c44fe319e89cb47dbce0539100207ba9595f08533c92164"}
Jul 27 21:25:38.442624 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:38.442441    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a432cd885b9c3f99c44fe319e89cb47dbce0539100207ba9595f08533c92164"
Jul 27 21:25:47.816779 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:47.816736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:47.895128 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:47.895100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:47.962340 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:47.962308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:52.224314 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:52.224280    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"]
Jul 27 21:25:52.227412 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:52.227376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:52.227790 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:52.227770    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-91a310-sn948"]
Jul 27 21:25:52.608788 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:52.608712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:25:53.983296 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:53.983220    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="370404c5-487e-43b3-b6bb-50cb50d0f59c" path="/var/lib/kubelet/pods/370404c5-487e-43b3-b6bb-50cb50d0f59c/volumes"
Jul 27 21:25:57.660957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:25:57.660927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:30.474013 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:30.473980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:34.658303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:34.658263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:34.812882 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:34.812846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:40.255306 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.255265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:40.355100 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.355070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:40.501272 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.501239    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:26:40.501539 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.501511    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy" containerID="cri-o://b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d" gracePeriod=30
Jul 27 21:26:40.526874 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.526809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:40.765257 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:40.765221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:45.762694 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.762670    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:26:45.824750 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.824668    2563 generic.go:356] "Generic (PLEG): container finished" podID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerID="b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d" exitCode=0
Jul 27 21:26:45.824750 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.824722    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"
Jul 27 21:26:45.824957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.824745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerDied","Data":"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"}
Jul 27 21:26:45.824957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.824796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq" event={"ID":"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41","Type":"ContainerDied","Data":"cd2da5cbc3c689844b235e5c976fe903df0c82f9cad7e16e645cabf0acc331de"}
Jul 27 21:26:45.824957 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.824818    2563 scope.go:117] "RemoveContainer" containerID="b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"
Jul 27 21:26:45.834252 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834235    2563 scope.go:117] "RemoveContainer" containerID="fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"
Jul 27 21:26:45.834478 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834546 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834546 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834526    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834659 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834574    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834659 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834605    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xwcq\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834659 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834820 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834820 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834820 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834743    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs\") pod \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\" (UID: \"84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41\") "
Jul 27 21:26:45.834820 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.834748    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:26:45.835058 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.835047    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.835304 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.835271    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:26:45.835512 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.835487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:26:45.835594 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.835551    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:26:45.835845 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.835816    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data" (OuterVolumeSpecName: "istio-data") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:26:45.836783 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.836759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:26:45.837061 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.836937    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:26:45.837347 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.837329    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq" (OuterVolumeSpecName: "kube-api-access-6xwcq") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "kube-api-access-6xwcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:45.837450 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.837418    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token" (OuterVolumeSpecName: "istio-token") pod "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" (UID: "84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:26:45.855760 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.855740    2563 scope.go:117] "RemoveContainer" containerID="b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"
Jul 27 21:26:45.856057 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:26:45.856037    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d\": container with ID starting with b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d not found: ID does not exist" containerID="b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"
Jul 27 21:26:45.856122 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.856067    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d"} err="failed to get container status \"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d\": rpc error: code = NotFound desc = could not find container \"b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d\": container with ID starting with b375816ea120b656620aa4b0527368f6ca277295de082b2095c0954e8a88de7d not found: ID does not exist"
Jul 27 21:26:45.856122 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.856087    2563 scope.go:117] "RemoveContainer" containerID="fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"
Jul 27 21:26:45.856367 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:26:45.856347    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc\": container with ID starting with fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc not found: ID does not exist" containerID="fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"
Jul 27 21:26:45.856420 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.856372    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc"} err="failed to get container status \"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc\": rpc error: code = NotFound desc = could not find container \"fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc\": container with ID starting with fff37fd3e922afe68468efcdd5f1488c19f58bde370b36f6b82a03793c1a57fc not found: ID does not exist"
Jul 27 21:26:45.935724 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935702    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935724 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935721    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935731    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935739    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935747    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935756    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935765    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:45.935851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:45.935772    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xwcq\" (UniqueName: \"kubernetes.io/projected/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41-kube-api-access-6xwcq\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:26:46.145355 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:46.145279    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:26:46.156791 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:46.156760    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-91a310-openshift-default-598758cdcb-dq7rq"]
Jul 27 21:26:47.982861 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:47.982828    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" path="/var/lib/kubelet/pods/84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41/volumes"
Jul 27 21:26:51.367139 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:51.367100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:51.510360 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:51.510327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:51.609529 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:51.609484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:55.965595 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:55.965560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:26:56.395533 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:26:56.395456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:02.690758 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:02.690721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:02.771403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:02.771373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:02.962243 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:02.962156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:03.168677 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.168639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:03.313048 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.312970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"]
Jul 27 21:27:03.313357 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313344    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:27:03.313403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313359    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:27:03.313403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313379    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="370404c5-487e-43b3-b6bb-50cb50d0f59c" containerName="revoke-keys"
Jul 27 21:27:03.313403 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313385    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="370404c5-487e-43b3-b6bb-50cb50d0f59c" containerName="revoke-keys"
Jul 27 21:27:03.313499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313442    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:27:03.313499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313450    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:27:03.313499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.313459    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="370404c5-487e-43b3-b6bb-50cb50d0f59c" containerName="revoke-keys"
Jul 27 21:27:03.316586 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.316570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:03.318870 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.318845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:27:03.319016 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.318887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d2vhj\""
Jul 27 21:27:03.324591 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.324565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"]
Jul 27 21:27:03.394844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.394811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8\" (UID: \"3c25c465-1860-4e98-bf81-1dd2294ce91f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:03.495539 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.495509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8\" (UID: \"3c25c465-1860-4e98-bf81-1dd2294ce91f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:03.496217 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.496195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8\" (UID: \"3c25c465-1860-4e98-bf81-1dd2294ce91f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:03.628201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.628125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:03.766210 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.766186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"]
Jul 27 21:27:03.767158 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:27:03.767134    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c25c465_1860_4e98_bf81_1dd2294ce91f.slice/crio-31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a WatchSource:0}: Error finding container 31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a: Status 404 returned error can't find the container with id 31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a
Jul 27 21:27:03.933192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:03.933152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8" event={"ID":"3c25c465-1860-4e98-bf81-1dd2294ce91f","Type":"ContainerStarted","Data":"31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a"}
Jul 27 21:27:04.940730 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:04.940690    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c25c465-1860-4e98-bf81-1dd2294ce91f" containerID="47ec2e7a0d62c694f62d2fd8ce52fab04d501e1bd9044f3d1f25b85d23450cf4" exitCode=0
Jul 27 21:27:04.941192 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:04.940777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8" event={"ID":"3c25c465-1860-4e98-bf81-1dd2294ce91f","Type":"ContainerDied","Data":"47ec2e7a0d62c694f62d2fd8ce52fab04d501e1bd9044f3d1f25b85d23450cf4"}
Jul 27 21:27:06.081539 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.081512    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:06.114569 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.114539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca\") pod \"3c25c465-1860-4e98-bf81-1dd2294ce91f\" (UID: \"3c25c465-1860-4e98-bf81-1dd2294ce91f\") "
Jul 27 21:27:06.114862 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.114842    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c25c465-1860-4e98-bf81-1dd2294ce91f" (UID: "3c25c465-1860-4e98-bf81-1dd2294ce91f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:06.215801 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.215738    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c25c465-1860-4e98-bf81-1dd2294ce91f-maas-api-service-ca\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:06.952668 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.952637    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"
Jul 27 21:27:06.952851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.952676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8" event={"ID":"3c25c465-1860-4e98-bf81-1dd2294ce91f","Type":"ContainerDied","Data":"31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a"}
Jul 27 21:27:06.952851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:06.952721    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31a0c3132fbf1e7564c5880c308595ab83f34468057b3ca6cb7d395c8a7e0b5a"
Jul 27 21:27:13.106179 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:13.106143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:13.187523 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:13.187490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:13.839871 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:13.839820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:13.939696 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:13.939664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:14.040472 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:14.040438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:18.400829 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:18.400773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:18.402107 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:18.402081    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"]
Jul 27 21:27:18.404356 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:18.404337    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-69909d-2k5m8"]
Jul 27 21:27:18.778952 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:18.778920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:19.982771 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:19.982740    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c25c465-1860-4e98-bf81-1dd2294ce91f" path="/var/lib/kubelet/pods/3c25c465-1860-4e98-bf81-1dd2294ce91f/volumes"
Jul 27 21:27:24.884753 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:24.884667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:24.952048 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:24.951998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:25.132265 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:25.132233    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:27:25.132497 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:25.132475    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy" containerID="cri-o://bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79" gracePeriod=30
Jul 27 21:27:25.163153 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:25.163125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:25.384932 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:25.384901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:30.392303 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.392279    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:27:30.531413 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531383    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcx2n\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531460    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531504    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531566 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531802 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531802 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531802 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy\") pod \"550fb82e-9dcb-467b-bc89-fb9e366d569c\" (UID: \"550fb82e-9dcb-467b-bc89-fb9e366d569c\") "
Jul 27 21:27:30.531989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531814    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:30.531989 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.531915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:30.532113 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:30.532113 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:30.532264 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532227    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.532264 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532251    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.532375 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532268    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550fb82e-9dcb-467b-bc89-fb9e366d569c-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.532375 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532283    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.532873 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.532850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data" (OuterVolumeSpecName: "istio-data") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:30.533737 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.533712    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:27:30.533847 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.533799    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:30.534016 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.533988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n" (OuterVolumeSpecName: "kube-api-access-vcx2n") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "kube-api-access-vcx2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:30.534216 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.534196    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token" (OuterVolumeSpecName: "istio-token") pod "550fb82e-9dcb-467b-bc89-fb9e366d569c" (UID: "550fb82e-9dcb-467b-bc89-fb9e366d569c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:30.633000 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.632976    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.633000 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.632998    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcx2n\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-kube-api-access-vcx2n\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.633168 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.633007    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.633168 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.633015    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:30.633168 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:30.633026    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550fb82e-9dcb-467b-bc89-fb9e366d569c-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:31.089683 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.089643    2563 generic.go:356] "Generic (PLEG): container finished" podID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerID="bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79" exitCode=0
Jul 27 21:27:31.089893 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.089697    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"
Jul 27 21:27:31.089893 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.089737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerDied","Data":"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"}
Jul 27 21:27:31.089893 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.089804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n" event={"ID":"550fb82e-9dcb-467b-bc89-fb9e366d569c","Type":"ContainerDied","Data":"752d8ffcc0cb4b8df4e0e90ce18fad1d61353a33b052fc81d580b216cca15519"}
Jul 27 21:27:31.089893 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.089835    2563 scope.go:117] "RemoveContainer" containerID="bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"
Jul 27 21:27:31.099432 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.099418    2563 scope.go:117] "RemoveContainer" containerID="fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"
Jul 27 21:27:31.107933 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.107918    2563 scope.go:117] "RemoveContainer" containerID="bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"
Jul 27 21:27:31.108212 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:27:31.108191    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79\": container with ID starting with bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79 not found: ID does not exist" containerID="bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"
Jul 27 21:27:31.108268 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.108221    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79"} err="failed to get container status \"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79\": rpc error: code = NotFound desc = could not find container \"bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79\": container with ID starting with bb328686e9ce5f5f12621962474e2d90ab098de4ee112865dba63ed1cc318e79 not found: ID does not exist"
Jul 27 21:27:31.108268 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.108237    2563 scope.go:117] "RemoveContainer" containerID="fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"
Jul 27 21:27:31.108470 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:27:31.108454    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e\": container with ID starting with fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e not found: ID does not exist" containerID="fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"
Jul 27 21:27:31.108510 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.108477    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e"} err="failed to get container status \"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e\": rpc error: code = NotFound desc = could not find container \"fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e\": container with ID starting with fc92858122e67816679a6d9ecbf80392f1d5d28fd79a901d0fb6ac46e028752e not found: ID does not exist"
Jul 27 21:27:31.113461 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.113442    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:27:31.117548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.117528    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-69909d-openshift-default-897c9c468-t257n"]
Jul 27 21:27:31.983134 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:31.983101    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" path="/var/lib/kubelet/pods/550fb82e-9dcb-467b-bc89-fb9e366d569c/volumes"
Jul 27 21:27:35.958461 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:35.958429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:35.986483 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:35.986447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:27:35.986691 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:35.986664    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" podUID="e4e59dd1-7b26-4509-b0de-0aecea375c25" containerName="payload-processing" containerID="cri-o://9fe7e95b7a1d40e085d41aa74f55d94194d931537463a6e92de767a0d1ab1821" gracePeriod=30
Jul 27 21:27:36.025799 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.025749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:36.119784 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.119755    2563 generic.go:356] "Generic (PLEG): container finished" podID="e4e59dd1-7b26-4509-b0de-0aecea375c25" containerID="9fe7e95b7a1d40e085d41aa74f55d94194d931537463a6e92de767a0d1ab1821" exitCode=0
Jul 27 21:27:36.119909 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.119806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" event={"ID":"e4e59dd1-7b26-4509-b0de-0aecea375c25","Type":"ContainerDied","Data":"9fe7e95b7a1d40e085d41aa74f55d94194d931537463a6e92de767a0d1ab1821"}
Jul 27 21:27:36.127084 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.127057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:36.261976 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.261941    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:27:36.389343 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.389315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume\") pod \"e4e59dd1-7b26-4509-b0de-0aecea375c25\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") "
Jul 27 21:27:36.389343 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.389347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff7pn\" (UniqueName: \"kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn\") pod \"e4e59dd1-7b26-4509-b0de-0aecea375c25\" (UID: \"e4e59dd1-7b26-4509-b0de-0aecea375c25\") "
Jul 27 21:27:36.389689 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.389659    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e4e59dd1-7b26-4509-b0de-0aecea375c25" (UID: "e4e59dd1-7b26-4509-b0de-0aecea375c25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:36.391406 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.391383    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn" (OuterVolumeSpecName: "kube-api-access-ff7pn") pod "e4e59dd1-7b26-4509-b0de-0aecea375c25" (UID: "e4e59dd1-7b26-4509-b0de-0aecea375c25"). InnerVolumeSpecName "kube-api-access-ff7pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:36.490421 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.490389    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4e59dd1-7b26-4509-b0de-0aecea375c25-plugins-config-volume\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:36.490421 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:36.490415    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff7pn\" (UniqueName: \"kubernetes.io/projected/e4e59dd1-7b26-4509-b0de-0aecea375c25-kube-api-access-ff7pn\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:37.126527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.126491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9" event={"ID":"e4e59dd1-7b26-4509-b0de-0aecea375c25","Type":"ContainerDied","Data":"bad7356b2ba86bbdee83cdd10e5dd448296eff077931140aa5683349a99450db"}
Jul 27 21:27:37.126936 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.126500    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"
Jul 27 21:27:37.126936 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.126557    2563 scope.go:117] "RemoveContainer" containerID="9fe7e95b7a1d40e085d41aa74f55d94194d931537463a6e92de767a0d1ab1821"
Jul 27 21:27:37.148098 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.148067    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:27:37.158459 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.158432    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ba2511-5dbc479758-bndq9"]
Jul 27 21:27:37.984788 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:37.984743    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4e59dd1-7b26-4509-b0de-0aecea375c25" path="/var/lib/kubelet/pods/e4e59dd1-7b26-4509-b0de-0aecea375c25/volumes"
Jul 27 21:27:40.586703 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:40.586669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:40.959918 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:40.959879    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:47.086695 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.086660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:47.175121 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.175085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:47.316851 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.316818    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:27:47.317112 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.317082    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy" containerID="cri-o://1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6" gracePeriod=30
Jul 27 21:27:47.339064 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.338995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:47.574669 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:47.574628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:27:48.019148 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:48.019121    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb9cb66f8-4nqtz_f70fb6f5-b982-4958-9a15-1befb3d87964/authorino/0.log"
Jul 27 21:27:52.571011 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.570985    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:27:52.638843 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.638843 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638812    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.638970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlnpf\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639063 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639044    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639387 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket\") pod \"240bc724-526e-4424-9a09-a4762e714794\" (UID: \"240bc724-526e-4424-9a09-a4762e714794\") "
Jul 27 21:27:52.639387 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:52.639497 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639416    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-certs\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.639497 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639477    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:27:52.639610 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:52.639664 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:52.639725 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.639691    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data" (OuterVolumeSpecName: "istio-data") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:52.641200 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.641154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:27:52.641312 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.641297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf" (OuterVolumeSpecName: "kube-api-access-tlnpf") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "kube-api-access-tlnpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:52.641464 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.641445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token" (OuterVolumeSpecName: "istio-token") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:27:52.641533 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.641519    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "240bc724-526e-4424-9a09-a4762e714794" (UID: "240bc724-526e-4424-9a09-a4762e714794"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:27:52.740672 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740646    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-data\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740672 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740668    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/240bc724-526e-4424-9a09-a4762e714794-istio-podinfo\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740672 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740677    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/240bc724-526e-4424-9a09-a4762e714794-istiod-ca-cert\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740859 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740685    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-istio-token\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740859 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740693    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlnpf\" (UniqueName: \"kubernetes.io/projected/240bc724-526e-4424-9a09-a4762e714794-kube-api-access-tlnpf\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740859 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740702    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-credential-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740859 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740710    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-workload-socket\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:52.740859 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:52.740718    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/240bc724-526e-4424-9a09-a4762e714794-istio-envoy\") on node \"ip-10-0-140-195.ec2.internal\" DevicePath \"\""
Jul 27 21:27:53.224987 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.224930    2563 generic.go:356] "Generic (PLEG): container finished" podID="240bc724-526e-4424-9a09-a4762e714794" containerID="1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6" exitCode=0
Jul 27 21:27:53.225173 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.225003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"
Jul 27 21:27:53.225173 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.225012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerDied","Data":"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"}
Jul 27 21:27:53.225173 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.225056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c" event={"ID":"240bc724-526e-4424-9a09-a4762e714794","Type":"ContainerDied","Data":"5c8170180552b62dad6e01eb1b3e096ee7ccbb56a925438bf01c197fcb55e303"}
Jul 27 21:27:53.225173 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.225077    2563 scope.go:117] "RemoveContainer" containerID="1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"
Jul 27 21:27:53.234862 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.234842    2563 scope.go:117] "RemoveContainer" containerID="7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"
Jul 27 21:27:53.243274 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.243258    2563 scope.go:117] "RemoveContainer" containerID="1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"
Jul 27 21:27:53.243487 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:27:53.243469    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6\": container with ID starting with 1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6 not found: ID does not exist" containerID="1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"
Jul 27 21:27:53.243527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.243498    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6"} err="failed to get container status \"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6\": rpc error: code = NotFound desc = could not find container \"1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6\": container with ID starting with 1b402723c2e30c98fd66aaf997a782f33a36e5e905454d17d2390c4a96622ba6 not found: ID does not exist"
Jul 27 21:27:53.243527 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.243522    2563 scope.go:117] "RemoveContainer" containerID="7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"
Jul 27 21:27:53.243755 ip-10-0-140-195 kubenswrapper[2563]: E0727 21:27:53.243739    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69\": container with ID starting with 7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69 not found: ID does not exist" containerID="7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"
Jul 27 21:27:53.243802 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.243762    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69"} err="failed to get container status \"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69\": rpc error: code = NotFound desc = could not find container \"7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69\": container with ID starting with 7cf52a4dce4a8a9fdc9e478738018df484e691c784b8800083379108ec314d69 not found: ID does not exist"
Jul 27 21:27:53.247061 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.247040    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:27:53.252863 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.252840    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ba2511-openshift-default-8569b85b5b-txw8c"]
Jul 27 21:27:53.505458 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.505386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ss7qk_f43fcd8d-8205-4011-92d9-d6c503313080/manager/0.log"
Jul 27 21:27:53.617522 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.617492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-glhfw_b06fb06f-9477-4820-ab61-4d06b81e839e/manager/0.log"
Jul 27 21:27:53.982935 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:53.982900    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240bc724-526e-4424-9a09-a4762e714794" path="/var/lib/kubelet/pods/240bc724-526e-4424-9a09-a4762e714794/volumes"
Jul 27 21:27:54.224435 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:54.224408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-ht6n6_b2642eb3-ec30-4bb5-9b0b-f57182315611/manager/0.log"
Jul 27 21:27:54.230626 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:54.230602    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-ht6n6_b2642eb3-ec30-4bb5-9b0b-f57182315611/copy-manifests/0.log"
Jul 27 21:27:55.926786 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:55.926758    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/util/0.log"
Jul 27 21:27:55.933439 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:55.933415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/pull/0.log"
Jul 27 21:27:55.939373 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:55.939356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/extract/0.log"
Jul 27 21:27:56.045436 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.045415    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/util/0.log"
Jul 27 21:27:56.052367 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.052335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/pull/0.log"
Jul 27 21:27:56.058660 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.058644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/extract/0.log"
Jul 27 21:27:56.167132 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.167104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/util/0.log"
Jul 27 21:27:56.173385 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.173362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/pull/0.log"
Jul 27 21:27:56.179238 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.179191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/extract/0.log"
Jul 27 21:27:56.290598 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.290576    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/util/0.log"
Jul 27 21:27:56.296132 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.296115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/pull/0.log"
Jul 27 21:27:56.303619 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.303602    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/extract/0.log"
Jul 27 21:27:56.418301 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.418279    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb9cb66f8-4nqtz_f70fb6f5-b982-4958-9a15-1befb3d87964/authorino/0.log"
Jul 27 21:27:56.656938 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.656869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm2kj_e6090f9d-7086-4eb1-8fb3-524cace6cd9c/manager/0.log"
Jul 27 21:27:56.765726 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.765701    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-58rcq_bb1c2cbe-5a8d-49da-b182-758966aff2df/kuadrant-console-plugin/0.log"
Jul 27 21:27:56.882734 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:56.882706    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqxbp_ab73b538-f1c5-4145-97d3-23c53371dbe2/registry-server/0.log"
Jul 27 21:27:57.003740 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:57.003716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7mpt7_82af687e-f274-4392-8392-756b5fa7662f/manager/0.log"
Jul 27 21:27:57.616108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:57.616083    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj_b204c45e-2b4d-4202-a387-3f29ef70101c/istio-proxy/0.log"
Jul 27 21:27:58.085499 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:58.085467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/1.log"
Jul 27 21:27:58.326840 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:58.326799    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"
Jul 27 21:27:59.023567 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:59.023537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cwchk_1e8c989e-33c5-4943-824b-0c69d94dccc5/main/0.log"
Jul 27 21:27:59.367648 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:27:59.367577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-c4nh6_dd1a49f1-4d20-40dd-af8b-1d0a5e55b222/main/0.log"
Jul 27 21:28:05.205880 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:05.205846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:05.278162 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:05.278127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:06.208083 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:06.208050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log" limit=1024
Jul 27 21:28:08.147321 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:08.147274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrhdg_3295c789-7119-4780-9f0f-2e658d8b3bef/global-pull-secret-syncer/0.log"
Jul 27 21:28:08.233777 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:08.233748    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mjwgc_54de0569-bde8-4abf-9e79-9add0750da49/konnectivity-agent/0.log"
Jul 27 21:28:08.346495 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:08.346469    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-195.ec2.internal_c2959093a1dac1f70892d700ea2e2faf/haproxy/0.log"
Jul 27 21:28:12.869694 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:12.869667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/extract/0.log"
Jul 27 21:28:12.899282 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:12.899254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/util/0.log"
Jul 27 21:28:12.928478 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:12.928454    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594nnrt_cfd83344-9392-4a23-959d-b2f3102de726/pull/0.log"
Jul 27 21:28:12.961410 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:12.961383    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/extract/0.log"
Jul 27 21:28:12.990810 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:12.990791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/util/0.log"
Jul 27 21:28:13.018340 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.018318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02bxj2_a98a07da-8d4b-498f-be26-9d29ee62d5e7/pull/0.log"
Jul 27 21:28:13.046429 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.046410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/extract/0.log"
Jul 27 21:28:13.071031 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.071015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/util/0.log"
Jul 27 21:28:13.093383 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.093364    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x22k6_fc81d914-c1fa-4990-bdab-48704bacbb37/pull/0.log"
Jul 27 21:28:13.120562 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.120514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/extract/0.log"
Jul 27 21:28:13.160099 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.160082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/util/0.log"
Jul 27 21:28:13.187081 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.187063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzbc_8237d713-fc21-4a19-908a-84ec9c1472d5/pull/0.log"
Jul 27 21:28:13.578330 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.578278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cb9cb66f8-4nqtz_f70fb6f5-b982-4958-9a15-1befb3d87964/authorino/0.log"
Jul 27 21:28:13.633714 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.633688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dm2kj_e6090f9d-7086-4eb1-8fb3-524cace6cd9c/manager/0.log"
Jul 27 21:28:13.661365 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.661345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-58rcq_bb1c2cbe-5a8d-49da-b182-758966aff2df/kuadrant-console-plugin/0.log"
Jul 27 21:28:13.709061 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.709024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqxbp_ab73b538-f1c5-4145-97d3-23c53371dbe2/registry-server/0.log"
Jul 27 21:28:13.818222 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:13.818195    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7mpt7_82af687e-f274-4392-8392-756b5fa7662f/manager/0.log"
Jul 27 21:28:15.969686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:15.969658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s96nq_6fd95920-9649-4cac-8e58-0f6574495552/kube-state-metrics/0.log"
Jul 27 21:28:16.003692 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.003669    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s96nq_6fd95920-9649-4cac-8e58-0f6574495552/kube-rbac-proxy-main/0.log"
Jul 27 21:28:16.025937 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.025909    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-s96nq_6fd95920-9649-4cac-8e58-0f6574495552/kube-rbac-proxy-self/0.log"
Jul 27 21:28:16.052244 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.052220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d585f8fc-zrzl8_3872055a-363c-4d87-8cd8-44000d11d7af/metrics-server/0.log"
Jul 27 21:28:16.090376 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.090343    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-k4zff_ff95f7a1-7ef7-4def-a890-2c76a98809f7/monitoring-plugin/0.log"
Jul 27 21:28:16.126012 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.125987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtnfd_3de9c471-ea5b-44cc-b421-16547d1d77a1/node-exporter/0.log"
Jul 27 21:28:16.153222 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.153205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtnfd_3de9c471-ea5b-44cc-b421-16547d1d77a1/kube-rbac-proxy/0.log"
Jul 27 21:28:16.178674 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.178652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtnfd_3de9c471-ea5b-44cc-b421-16547d1d77a1/init-textfile/0.log"
Jul 27 21:28:16.681807 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.681784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-gpqbf_25422b9d-0239-4343-a67e-5e87092553f8/prometheus-operator-admission-webhook/0.log"
Jul 27 21:28:16.798910 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.798886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/thanos-query/0.log"
Jul 27 21:28:16.824686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.824659    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/kube-rbac-proxy-web/0.log"
Jul 27 21:28:16.846575 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.846532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/kube-rbac-proxy/0.log"
Jul 27 21:28:16.871157 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.871134    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/prom-label-proxy/0.log"
Jul 27 21:28:16.893048 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.893029    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/kube-rbac-proxy-rules/0.log"
Jul 27 21:28:16.919575 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:16.919544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-584d8b5bff-8vckb_ed4b1489-e179-43f8-8f98-9a007806fdbe/kube-rbac-proxy-metrics/0.log"
Jul 27 21:28:17.425321 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425291    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"]
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425631    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c25c465-1860-4e98-bf81-1dd2294ce91f" containerName="revoke-keys"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425641    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c25c465-1860-4e98-bf81-1dd2294ce91f" containerName="revoke-keys"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425654    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425660    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425675    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425682    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e59dd1-7b26-4509-b0de-0aecea375c25" containerName="payload-processing"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425688    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e59dd1-7b26-4509-b0de-0aecea375c25" containerName="payload-processing"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425695    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425700    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bbe06f-2bd4-46b6-ab7c-5aeef3d8dc41" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425764    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="240bc724-526e-4424-9a09-a4762e714794" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425778    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425788    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="550fb82e-9dcb-467b-bc89-fb9e366d569c" containerName="istio-proxy"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425799    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4e59dd1-7b26-4509-b0de-0aecea375c25" containerName="payload-processing"
Jul 27 21:28:17.425844 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.425807    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c25c465-1860-4e98-bf81-1dd2294ce91f" containerName="revoke-keys"
Jul 27 21:28:17.429068 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.429049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.431290 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.431272    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7p9dx\"/\"kube-root-ca.crt\""
Jul 27 21:28:17.432107 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.432093    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7p9dx\"/\"openshift-service-ca.crt\""
Jul 27 21:28:17.432170 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.432127    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7p9dx\"/\"default-dockercfg-vg9jk\""
Jul 27 21:28:17.438582 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.438561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"]
Jul 27 21:28:17.562800 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.562766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsccr\" (UniqueName: \"kubernetes.io/projected/39c0a72e-42b4-4f67-b821-703164828ffa-kube-api-access-tsccr\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.562956 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.562818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-proc\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.562956 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.562889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-podres\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.562956 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.562924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-sys\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.562956 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.562946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-lib-modules\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.663946 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.663914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsccr\" (UniqueName: \"kubernetes.io/projected/39c0a72e-42b4-4f67-b821-703164828ffa-kube-api-access-tsccr\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.663951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-proc\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-podres\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-sys\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-lib-modules\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664142 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-sys\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664347 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-proc\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664347 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-podres\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.664347 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.664195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39c0a72e-42b4-4f67-b821-703164828ffa-lib-modules\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.672243 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.672219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsccr\" (UniqueName: \"kubernetes.io/projected/39c0a72e-42b4-4f67-b821-703164828ffa-kube-api-access-tsccr\") pod \"perf-node-gather-daemonset-hft74\" (UID: \"39c0a72e-42b4-4f67-b821-703164828ffa\") " pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.740201 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.740110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:17.869288 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:17.869259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"]
Jul 27 21:28:17.872311 ip-10-0-140-195 kubenswrapper[2563]: W0727 21:28:17.872282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39c0a72e_42b4_4f67_b821_703164828ffa.slice/crio-c28a84b2eb5dae4007ccd9d2e06a8e52d92f890975586cb50ef1f6fb4c9335c8 WatchSource:0}: Error finding container c28a84b2eb5dae4007ccd9d2e06a8e52d92f890975586cb50ef1f6fb4c9335c8: Status 404 returned error can't find the container with id c28a84b2eb5dae4007ccd9d2e06a8e52d92f890975586cb50ef1f6fb4c9335c8
Jul 27 21:28:18.360217 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:18.360124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74" event={"ID":"39c0a72e-42b4-4f67-b821-703164828ffa","Type":"ContainerStarted","Data":"fcd9487b22dffa9fd4a9f7c3422ec0092b9636419f26fa04d71e4cf4935133b9"}
Jul 27 21:28:18.360217 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:18.360185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74" event={"ID":"39c0a72e-42b4-4f67-b821-703164828ffa","Type":"ContainerStarted","Data":"c28a84b2eb5dae4007ccd9d2e06a8e52d92f890975586cb50ef1f6fb4c9335c8"}
Jul 27 21:28:18.360410 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:18.360279    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:18.378382 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:18.378337    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74" podStartSLOduration=1.378323746 podStartE2EDuration="1.378323746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:28:18.376164845 +0000 UTC m=+3196.980649732" watchObservedRunningTime="2026-07-27 21:28:18.378323746 +0000 UTC m=+3196.982808620"
Jul 27 21:28:21.001549 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:21.001513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7mhr2_0ddd3487-b7f4-4895-9be4-54cd1a8a984e/dns/0.log"
Jul 27 21:28:21.024687 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:21.024663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7mhr2_0ddd3487-b7f4-4895-9be4-54cd1a8a984e/kube-rbac-proxy/0.log"
Jul 27 21:28:21.074762 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:21.074735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9k6z_2d998e2a-dacd-4e18-97f8-6a70986d3fbd/dns-node-resolver/0.log"
Jul 27 21:28:21.609422 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:21.609377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-769b64b76-5kxjb_213105bd-d07d-479a-b16b-3c0fa5fa0cbe/registry/0.log"
Jul 27 21:28:21.657712 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:21.657663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxxvg_910d687d-8698-4e16-85f1-701b47bc2e11/node-ca/0.log"
Jul 27 21:28:22.592646 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:22.592620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj_b204c45e-2b4d-4202-a387-3f29ef70101c/istio-proxy/0.log"
Jul 27 21:28:22.949219 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:22.949188    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/0.log"
Jul 27 21:28:22.975188 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:22.975165    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/1.log"
Jul 27 21:28:23.048440 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:23.048418    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"
Jul 27 21:28:23.907226 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:23.907197    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w62fv_18c12568-02b9-402e-8a23-f041165c1c41/serve-healthcheck-canary/0.log"
Jul 27 21:28:24.374548 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:24.374522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7p9dx/perf-node-gather-daemonset-hft74"
Jul 27 21:28:24.395869 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:24.395820    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-58gx2_e1dc6c03-f62e-4c15-9d05-fa4b5218a63f/kube-rbac-proxy/0.log"
Jul 27 21:28:24.421124 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:24.421097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-58gx2_e1dc6c03-f62e-4c15-9d05-fa4b5218a63f/exporter/0.log"
Jul 27 21:28:24.443487 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:24.443452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-58gx2_e1dc6c03-f62e-4c15-9d05-fa4b5218a63f/extractor/0.log"
Jul 27 21:28:26.895733 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:26.895710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ss7qk_f43fcd8d-8205-4011-92d9-d6c503313080/manager/0.log"
Jul 27 21:28:27.123108 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:27.123082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-glhfw_b06fb06f-9477-4820-ab61-4d06b81e839e/manager/0.log"
Jul 27 21:28:27.595573 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:27.595487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-ht6n6_b2642eb3-ec30-4bb5-9b0b-f57182315611/manager/0.log"
Jul 27 21:28:27.622103 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:27.622078    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b945668b-ht6n6_b2642eb3-ec30-4bb5-9b0b-f57182315611/copy-manifests/0.log"
Jul 27 21:28:27.892205 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:27.892127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj_b204c45e-2b4d-4202-a387-3f29ef70101c/istio-proxy/0.log"
Jul 27 21:28:28.193686 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:28.193653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/0.log"
Jul 27 21:28:28.218365 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:28.218336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/1.log"
Jul 27 21:28:28.274158 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:28.274134    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"
Jul 27 21:28:29.102570 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:29.102544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67d8f5d499-r78pn_b9c9620e-82ac-4da3-a7b2-66b44e3024d6/manager/0.log"
Jul 27 21:28:29.158172 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:29.158147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2fqp2_836aea92-df8e-4752-b6cc-0732d21f4261/openshift-lws-operator/0.log"
Jul 27 21:28:29.681995 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:29.681952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hk5jj_b204c45e-2b4d-4202-a387-3f29ef70101c/istio-proxy/0.log"
Jul 27 21:28:29.998246 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:29.998177    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/0.log"
Jul 27 21:28:30.022738 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:30.022711    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-l79q2_2a209711-6361-438d-b88e-f60e3e7139bb/istio-proxy/1.log"
Jul 27 21:28:30.079788 ip-10-0-140-195 kubenswrapper[2563]: I0727 21:28:30.079743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-85h24_6c03db0d-00e4-4a29-b897-41000205e49d/payload-processing/0.log"