Jul 31 21:36:02.941378 ip-10-0-134-210 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 21:36:03.408170 ip-10-0-134-210 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:03.408170 ip-10-0-134-210 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 21:36:03.408170 ip-10-0-134-210 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:03.408170 ip-10-0-134-210 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 21:36:03.408170 ip-10-0-134-210 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:03.408896 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.408180    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 21:36:03.413321 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413293    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.413321 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413319    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.413321 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413323    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.413321 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413326    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413329    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413333    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413336    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413339    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413342    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413345    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413348    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413351    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413353    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413358    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413360    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413363    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413366    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413369    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413372    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413375    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413377    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413382    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.413466 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413391    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413394    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413398    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413401    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413405    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413408    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413411    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413413    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413416    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413418    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413421    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413424    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413426    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413429    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413432    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413436    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413439    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413442    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413445    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413448    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.413928 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413450    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413453    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413456    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413458    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413461    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413464    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413468    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413470    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413473    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413476    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413479    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413482    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413485    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413488    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413490    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413493    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413495    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413498    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413500    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413503    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.414458 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413505    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413508    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413510    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413513    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413515    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413518    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413521    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413524    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413527    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413532    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413535    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413538    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413540    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413543    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413545    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413549    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413552    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413555    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413558    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.415005 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413562    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413566    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413569    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413572    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413575    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413577    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413580    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413583    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413586    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413588    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413591    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413593    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413595    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413598    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413601    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413603    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413606    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.413608    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414464    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414473    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.415491 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414477    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414480    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414484    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414488    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414491    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414494    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414497    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414501    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414513    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414519    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414522    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414525    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414528    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414530    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414534    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414539    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414542    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414545    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414548    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.415978 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414550    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414554    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414558    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414562    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414566    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414569    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414571    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414574    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414577    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414579    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414582    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414585    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414588    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414590    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414593    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414595    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414599    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414602    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414605    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.416484 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414608    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414610    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414613    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414615    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414618    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414620    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414623    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414625    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414628    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414630    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414633    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414635    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414638    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414640    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414643    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414645    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414648    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414650    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414653    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.416959 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414656    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414659    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414662    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414666    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414669    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414671    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414674    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414676    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414678    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414681    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414684    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414686    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414690    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414693    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414695    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414699    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414701    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414704    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414706    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414709    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.417468 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414712    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414714    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414717    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414719    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414722    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414725    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414728    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414731    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414733    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414736    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414739    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414742    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414744    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414747    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414750    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414752    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414755    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414758    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414760    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.414762    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.417974 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415193    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415199    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415202    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415204    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415208    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415210    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415213    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415217    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415219    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415223    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415229    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415234    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415236    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415239    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415242    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415245    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415247    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415250    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415253    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415255    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.418493 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415258    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415261    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415263    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415266    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415269    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415271    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415274    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415277    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415280    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415282    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415285    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415288    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415290    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415293    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415295    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415298    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415300    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415303    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415306    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.419000 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415309    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415312    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415315    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415319    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415323    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415326    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415329    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415331    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415334    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415337    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415339    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415342    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415344    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415347    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415349    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415352    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415354    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415357    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415359    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415362    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.419490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415365    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415369    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415372    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415376    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415379    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415382    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415385    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415388    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415391    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415393    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415396    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415399    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415401    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415404    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415408    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415415    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415419    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415422    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415424    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.420019 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415427    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415430    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415432    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415435    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415438    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415440    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415443    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415446    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415448    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415451    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415455    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415458    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415461    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415463    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415466    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415468    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415472    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415476    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415479    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.420503 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415482    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.415485    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415585    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415598    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415607    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415614    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415620    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415624    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415629    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415634    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415640    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415643    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415647    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415650    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415654    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415657    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415660    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415663    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415666    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415669    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415673    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415676    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415680    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415683    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 21:36:03.421021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415687    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415691    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415694    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415697    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415701    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415704    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415707    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415710    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415713    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415716    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415721    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415724    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415727    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415730    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415733    2568 flags.go:64] FLAG: --enable-server="true"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415737    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415742    2568 flags.go:64] FLAG: --event-burst="100"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415746    2568 flags.go:64] FLAG: --event-qps="50"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415751    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415754    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415757    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415761    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415764    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415768    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415771    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 31 21:36:03.421616 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415774    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415777    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415780    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415783    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415786    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415789    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415792    2568 flags.go:64] FLAG: --feature-gates=""
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415796    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415799    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415802    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415806    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415809    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415812    2568 flags.go:64] FLAG: --help="false"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415815    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415818    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415821    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415824    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415828    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415832    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415835    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415837    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415840    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415843    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 21:36:03.422246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415847    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415850    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415855    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415858    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415862    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415867    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415872    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415876    2568 flags.go:64] FLAG: --lock-file=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415881    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415885    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415889    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415895    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415898    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415901    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415904    2568 flags.go:64] FLAG: --logging-format="text"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415907    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415910    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415913    2568 flags.go:64] FLAG: --manifest-url=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415916    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415921    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415924    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415928    2568 flags.go:64] FLAG: --max-pods="110"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415931    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415934    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415937    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 21:36:03.422850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415941    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415944    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415947    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415950    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415958    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415961    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415964    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415967    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415972    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415978    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415983    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415987    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415990    2568 flags.go:64] FLAG: --port="10250"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415994    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.415997    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021443280dcd77c4f"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416000    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416003    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416018    2568 flags.go:64] FLAG: --register-node="true"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416022    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416025    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416029    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416032    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416035    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416039    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416043    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 21:36:03.423534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416047    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416050    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416053    2568 flags.go:64] FLAG: --runonce="false"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416056    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416059    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416062    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416066    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416068    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416072    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416075    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416078    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416081    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416084    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416087    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416090    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416093    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416097    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416102    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416107    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416110    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416113    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416117    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416120    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416123    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416126    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 21:36:03.424358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416129    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416132    2568 flags.go:64] FLAG: --v="2"
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416137    2568 flags.go:64] FLAG: --version="false"
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416141    2568 flags.go:64] FLAG: --vmodule=""
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416151    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.416155    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416287    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416291    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416294    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416297    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416300    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416303    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416306    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416309    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416311    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416314    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416317    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416320    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416323    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416326    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416329    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.425499 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416332    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416334    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416337    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416343    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416346    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416350    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416354    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416357    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416360    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416363    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416366    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416368    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416372    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416375    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416378    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416380    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416383    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416387    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416390    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.426474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416393    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416397    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416401    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416404    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416407    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416409    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416412    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416415    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416417    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416420    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416422    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416425    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416428    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416430    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416433    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416436    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416440    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416444    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416448    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.427325 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416451    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416455    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416457    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416460    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416463    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416466    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416469    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416472    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416474    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416477    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416480    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416485    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416488    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416491    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416493    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416496    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416499    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416502    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416504    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416507    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.428169 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416510    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416513    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416515    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416518    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416520    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416523    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416526    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416529    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416531    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416535    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416537    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416540    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416543    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416546    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416548    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416550    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416553    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416556    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416558    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416560    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416563    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.428806 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416565    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416568    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416572    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416575    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.416577    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.417501    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.426704    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.426737    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.426760    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.426770    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426862    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426872    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426878    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426883    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426887    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.429548 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426892    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426896    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426900    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426906    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426911    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426915    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426920    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426924    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426929    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426933    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426938    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426942    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426946    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426951    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426955    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426959    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426963    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426968    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426973    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426977    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.430187 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426981    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426985    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426990    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.426995    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427002    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427022    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427028    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427032    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427037    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427041    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427046    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427050    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427054    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427058    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427065    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427072    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427077    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427081    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427087    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.430965 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427093    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427097    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427104    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427110    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427115    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427120    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427125    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427130    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427134    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427139    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427143    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427148    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427152    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427156    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427161    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427166    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427171    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427179    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427187    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.431679 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427192    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427197    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427202    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427236    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427245    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427250    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427255    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427260    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427265    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427269    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427274    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427279    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427283    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427287    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427292    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427297    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427302    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427306    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427311    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427315    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.432334 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427319    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427323    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427327    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427331    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427335    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427339    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427343    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427347    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427351    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427355    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427360    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427364    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427370    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427374    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427379    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.432819 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427383    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.427392    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427595    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427604    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427609    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427614    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427619    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427624    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427629    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427633    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427637    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427641    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427646    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427653    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:03.433249 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427660    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427664    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427669    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427674    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427678    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427682    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427686    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427691    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427696    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427700    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427705    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427709    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427714    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427718    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427723    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427727    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427733    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427737    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427742    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427746    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:03.433604 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427750    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427754    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427759    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427766    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427772    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427777    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427782    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427787    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427791    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427795    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427799    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427804    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427810    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427817    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427822    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427827    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427831    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427837    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427841    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:03.434142 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427845    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427849    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427853    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427858    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427863    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427867    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427872    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427876    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427881    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427885    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427891    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427895    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427900    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427904    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427909    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427913    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427917    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427921    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427925    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427929    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:03.434721 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427934    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427939    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427943    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427947    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427951    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427955    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427960    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427964    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427968    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427972    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427976    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427980    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427985    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427989    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427993    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.427997    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428002    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428021    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428026    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428030    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:03.435556 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428035    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428040    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428045    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428058    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428063    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428068    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428072    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:03.428076    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.428085    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.428289    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.432748    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.434374    2568 server.go:1019] "Starting client certificate rotation"
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.434492    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:36:03.436129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.434547    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:36:03.437360 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.437340    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:36:03.439795 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.439772    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:36:03.447849 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.447824    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 31 21:36:03.450492 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.450468    2568 log.go:25] "Validated CRI v1 image API"
Jul 31 21:36:03.452987 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.452964    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 21:36:03.455756 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.455727    2568 fs.go:135] Filesystem UUIDs: map[3419d280-8e28-4eb6-abb8-10e01999a74a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 93c34595-3080-4340-b66a-30674b04b44f:/dev/nvme0n1p3]
Jul 31 21:36:03.455756 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.455750    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 21:36:03.460942 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.460910    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:36:03.462554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.462381    2568 manager.go:216] Machine: {Timestamp:2026-07-31 21:36:03.461807584 +0000 UTC m=+0.389946075 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100024 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e89d0e343fb13f755f4b9cc1e23cd SystemUUID:ec2e89d0-e343-fb13-f755-f4b9cc1e23cd BootID:cd7a2666-76cf-4aea-8f3f-951bfbb348c2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:b6:e9:13:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:b6:e9:13:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:a0:d8:08:6c:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 21:36:03.462554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.462533    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 21:36:03.462731 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.462670    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 21:36:03.466322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.466276    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 21:36:03.466559 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.466325    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-210.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 21:36:03.467322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.467307    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 21:36:03.467378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.467329    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 21:36:03.467378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.467341    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:36:03.467378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.467370    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:36:03.468740 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.468725    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 21:36:03.474201 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474166    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:36:03.474382 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474369    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 21:36:03.474440 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474412    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 21:36:03.474440 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474432    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 21:36:03.474543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474456    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 21:36:03.474543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474472    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 31 21:36:03.474543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474505    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 21:36:03.474980 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474963    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:36:03.475071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.474988    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:36:03.477484 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.477456    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 21:36:03.480964 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.480942    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 21:36:03.481088 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.480985    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 21:36:03.483561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483544    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 21:36:03.483561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483564    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483571    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483577    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483587    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483593    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483601    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483607    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483614    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483621    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483630    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 21:36:03.483646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483635    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 21:36:03.484064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483661    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 21:36:03.484064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.483667    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 21:36:03.486822 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.486796    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-210.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 21:36:03.486929 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.486836    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 21:36:03.486929 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.486850    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 21:36:03.487030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.486968    2568 server.go:1268] "Started kubelet"
Jul 31 21:36:03.487131 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.487068    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 21:36:03.487245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.487151    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 21:36:03.487245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.487065    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 21:36:03.488025 ip-10-0-134-210 systemd[1]: Started Kubernetes Kubelet.
Jul 31 21:36:03.489114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.489099    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 21:36:03.491290 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.491266    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 21:36:03.491478 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.491465    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 21:36:03.492881 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.491721    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-210.ec2.internal.18c77d7f6b1af6ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-210.ec2.internal,UID:ip-10-0-134-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-210.ec2.internal,},FirstTimestamp:2026-07-31 21:36:03.486938858 +0000 UTC m=+0.415077351,LastTimestamp:2026-07-31 21:36:03.486938858 +0000 UTC m=+0.415077351,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-210.ec2.internal,}"
Jul 31 21:36:03.497889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.497868    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 21:36:03.497889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.497874    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 21:36:03.498043 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.497999    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:03.498729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498711    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 21:36:03.498729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498712    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 21:36:03.498870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498740    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 21:36:03.498870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498754    2568 factory.go:55] Registering systemd factory
Jul 31 21:36:03.498870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498771    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 31 21:36:03.498870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498851    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 21:36:03.498870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.498860    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 21:36:03.499136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499002    2568 factory.go:153] Registering CRI-O factory
Jul 31 21:36:03.499136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499032    2568 factory.go:223] Registration of the crio container factory successfully
Jul 31 21:36:03.499136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499082    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 21:36:03.499136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499107    2568 factory.go:103] Registering Raw factory
Jul 31 21:36:03.499136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499132    2568 manager.go:1196] Started watching for new ooms in manager
Jul 31 21:36:03.499719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.499706    2568 manager.go:349] Starting recovery of all containers
Jul 31 21:36:03.500368 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.500336    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 21:36:03.500368 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.500341    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 21:36:03.506719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.506692    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 21:36:03.510776 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.510753    2568 manager.go:354] Recovery completed
Jul 31 21:36:03.516831 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.516714    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.518892 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.518872    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.518969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.518903    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.518969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.518915    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.519472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.519458    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 21:36:03.519472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.519471    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 21:36:03.519555 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.519477    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.519555 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.519486    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:36:03.520158 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.520143    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.520211 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.520171    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.520211 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.520182    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.521733 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.521720    2568 policy_none.go:49] "None policy: Start"
Jul 31 21:36:03.521779 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.521737    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 21:36:03.521779 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.521748    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 21:36:03.523771 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.523758    2568 policy_none.go:47] "Start"
Jul 31 21:36:03.528632 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.528538    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-210.ec2.internal.18c77d7f6d0281b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-210.ec2.internal,UID:ip-10-0-134-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-210.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-210.ec2.internal,},FirstTimestamp:2026-07-31 21:36:03.518890424 +0000 UTC m=+0.447028918,LastTimestamp:2026-07-31 21:36:03.518890424 +0000 UTC m=+0.447028918,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-210.ec2.internal,}"
Jul 31 21:36:03.531671 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.531649    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8k5cl"
Jul 31 21:36:03.540057 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.540005    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8k5cl"
Jul 31 21:36:03.541045 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.540952    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-210.ec2.internal.18c77d7f6d02c509  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-210.ec2.internal,UID:ip-10-0-134-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-210.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-210.ec2.internal,},FirstTimestamp:2026-07-31 21:36:03.518907657 +0000 UTC m=+0.447046150,LastTimestamp:2026-07-31 21:36:03.518907657 +0000 UTC m=+0.447046150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-210.ec2.internal,}"
Jul 31 21:36:03.571768 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.571747    2568 manager.go:337] "Starting Device Plugin manager"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.571799    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.571812    2568 server.go:87] "Starting device plugin registration server"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.572112    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.572124    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.572195    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.572326    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.572336    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.573003    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 21:36:03.584869 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.573084    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:03.610606 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.610578    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 21:36:03.610677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.610624    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 21:36:03.610677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.610648    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 21:36:03.610767 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.610680    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 21:36:03.613153 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.613131    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:03.672441 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.672344    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.673427 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.673405    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.673550 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.673443    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.673550 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.673453    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.673550 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.673480    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.682096 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.682079    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.682180 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.682103    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-210.ec2.internal\": node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:03.707206 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.707182    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:03.711340 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.711320    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"]
Jul 31 21:36:03.711403 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.711393    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.712973 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.712956    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.713077 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.712990    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.713077 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.713006    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.715451 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.715435    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.715560 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.715545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.715606 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.715581    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.716238 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716221    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.716309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716254    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.716309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716263    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.716309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716272    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.716309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716281    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.716309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.716294    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.718602 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.718581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.718679 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.718615    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:03.719378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.719363    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:03.719447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.719394    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:03.719447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.719409    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:03.739616 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.739593    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-210.ec2.internal\" not found" node="ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.743163 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.743148    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-210.ec2.internal\" not found" node="ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.801101 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.801065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.801101 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.801102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4933a03e6e601d67493ba375e1a2d98a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-210.ec2.internal\" (UID: \"4933a03e6e601d67493ba375e1a2d98a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.801271 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.801120    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.807919 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.807900    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:03.902060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.902060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4933a03e6e601d67493ba375e1a2d98a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-210.ec2.internal\" (UID: \"4933a03e6e601d67493ba375e1a2d98a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.902249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.902249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.902249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4933a03e6e601d67493ba375e1a2d98a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-210.ec2.internal\" (UID: \"4933a03e6e601d67493ba375e1a2d98a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.902249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:03.902140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56e00fe9e17bca71b844e02c2118b505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal\" (UID: \"56e00fe9e17bca71b844e02c2118b505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:03.908734 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:03.908716    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.008854 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.008778    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.041993 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.041962    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:04.045781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.045753    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:04.109371 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.109331    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.209978 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.209949    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.310553 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.310462    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.411110 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.411070    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.433180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.433156    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 21:36:04.433365 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.433344    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 21:36:04.511823 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.511790    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.544519 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.544492    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:04.546158 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.546119    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:31:04 +0000 UTC" deadline="2028-02-18 08:40:28.765861245 +0000 UTC"
Jul 31 21:36:04.546158 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.546151    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13595h4m24.219713641s"
Jul 31 21:36:04.558260 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:04.558224    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4933a03e6e601d67493ba375e1a2d98a.slice/crio-6e41033c89506a72255a8e56273030850708c9174d8bf9df8556f1b0299b2fd7 WatchSource:0}: Error finding container 6e41033c89506a72255a8e56273030850708c9174d8bf9df8556f1b0299b2fd7: Status 404 returned error can't find the container with id 6e41033c89506a72255a8e56273030850708c9174d8bf9df8556f1b0299b2fd7
Jul 31 21:36:04.558599 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:04.558576    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e00fe9e17bca71b844e02c2118b505.slice/crio-7ac6a73b16d835ecbc12b69191a92cd05436267b14817e2f5501b013dcbc25cb WatchSource:0}: Error finding container 7ac6a73b16d835ecbc12b69191a92cd05436267b14817e2f5501b013dcbc25cb: Status 404 returned error can't find the container with id 7ac6a73b16d835ecbc12b69191a92cd05436267b14817e2f5501b013dcbc25cb
Jul 31 21:36:04.562944 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.562927    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:36:04.612114 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.612068    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.618437 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.618388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal" event={"ID":"4933a03e6e601d67493ba375e1a2d98a","Type":"ContainerStarted","Data":"6e41033c89506a72255a8e56273030850708c9174d8bf9df8556f1b0299b2fd7"}
Jul 31 21:36:04.619632 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.619602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal" event={"ID":"56e00fe9e17bca71b844e02c2118b505","Type":"ContainerStarted","Data":"7ac6a73b16d835ecbc12b69191a92cd05436267b14817e2f5501b013dcbc25cb"}
Jul 31 21:36:04.659831 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.659792    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:04.661025 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.660991    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:04.661123 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.661038    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:04.661123 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.661054    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:04.712968 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:04.712935    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-210.ec2.internal\" not found"
Jul 31 21:36:04.803252 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.803209    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:04.898303 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.898192    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:04.909476 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.909440    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:36:04.910561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.910541    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal"
Jul 31 21:36:04.917067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.917002    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:36:04.952312 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:04.952285    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:05.300352 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.300257    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:05.475997 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.475950    2568 apiserver.go:52] "Watching apiserver"
Jul 31 21:36:05.481181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.481152    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 21:36:05.484286 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.484246    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-dhv4x","openshift-multus/network-metrics-daemon-h7nkh","openshift-network-diagnostics/network-check-target-mxxvz","kube-system/konnectivity-agent-7gn7f","kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal","openshift-cluster-node-tuning-operator/tuned-86ljz","openshift-multus/multus-additional-cni-plugins-lqbfb","openshift-network-operator/iptables-alerter-s5w6c","openshift-ovn-kubernetes/ovnkube-node-lshbt","kube-system/global-pull-secret-syncer-xm2fg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7","openshift-dns/node-resolver-k25gn","openshift-image-registry/node-ca-h64xh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal"]
Jul 31 21:36:05.487094 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.487062    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.489542 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.489515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.490681 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.490305    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 21:36:05.490681 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.490328    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.490889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.490819    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.490950 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.490887    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 21:36:05.491533 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.491116    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 21:36:05.491533 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.491211    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-42gq9\""
Jul 31 21:36:05.491533 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.491389    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.491804 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.491783    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 21:36:05.492595 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.492525    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.493438 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.493336    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tmhdb\""
Jul 31 21:36:05.493625 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.493606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:05.493718 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.493695    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:05.495577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.495556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.497770 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.497667    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 21:36:05.497916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.497898    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6dwf\""
Jul 31 21:36:05.499327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.498419    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 21:36:05.499327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.498494    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.499327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.499052    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 21:36:05.500312 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.500296    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.501174 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.500889    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.501271 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.501254    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.501869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.501849    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsppq\""
Jul 31 21:36:05.502601 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.502572    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 21:36:05.502871 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.502855    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.503354 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.503320    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.503610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.503591    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hknz5\""
Jul 31 21:36:05.503819 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.503804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.506319 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.506292    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 21:36:05.506577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.506554    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.510113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.510171    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.510241    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.510692    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.510949    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rz4fr\""
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-iptables-alerter-script\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.511483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z88v\" (UniqueName: \"kubernetes.io/projected/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-kube-api-access-9z88v\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-kubernetes\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-tmp\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-os-release\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511619    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-host-slash\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-modprobe-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-run\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-host\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmw6\" (UniqueName: \"kubernetes.io/projected/164bd51a-d5ea-4708-a456-c9dab2b5d09c-kube-api-access-djmw6\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511759    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmf4l\" (UniqueName: \"kubernetes.io/projected/be7d2f11-4da5-4f06-ad0f-4565081c8906-kube-api-access-hmf4l\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-registration-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-systemd\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-lib-modules\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5w5\" (UniqueName: \"kubernetes.io/projected/d317b71a-743f-442d-a9c5-d2185037cdb4-kube-api-access-7h5w5\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-var-lib-kubelet\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513106 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.511986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-system-cni-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-device-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-cnibin\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-socket-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-conf\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512266    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512312    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-tuned\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80112fed-0ee5-429d-99cf-394966dfb15c-agent-certs\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.512768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.512919    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-sys-fs\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513491    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysconfig\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.513847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-sys\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80112fed-0ee5-429d-99cf-394966dfb15c-konnectivity-ca\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.513890    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z86rc\""
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.514162    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.514677 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.514283    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.516600 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.515968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:05.519381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.518943    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:36:05.519381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.519186    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 21:36:05.519381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.519219    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 21:36:05.519592 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.519503    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2lc78\""
Jul 31 21:36:05.519728 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.519711    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 21:36:05.520530 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.520445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:05.520530 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.520516    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:05.522603 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.522586    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.524729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.524712    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 21:36:05.525068 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.525049    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q84cd\""
Jul 31 21:36:05.539342 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.539307    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn5jp"
Jul 31 21:36:05.548876 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.548847    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn5jp"
Jul 31 21:36:05.600508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.600473    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 21:36:05.614041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.613993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.614254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-os-release\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.614254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z88v\" (UniqueName: \"kubernetes.io/projected/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-kube-api-access-9z88v\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.614254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-kubernetes\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.614418 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614296    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-kubernetes\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-os-release\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q29t\" (UniqueName: \"kubernetes.io/projected/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-kube-api-access-8q29t\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-k8s-cni-cncf-io\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-daemon-config\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-etc-kubernetes\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614740    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-os-release\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-modprobe-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614809    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-run\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-host\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf4l\" (UniqueName: \"kubernetes.io/projected/be7d2f11-4da5-4f06-ad0f-4565081c8906-kube-api-access-hmf4l\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614947    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-modprobe-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.614991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-host\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-registration-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-run\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.615105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-var-lib-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-registration-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615163    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-722bw\" (UniqueName: \"kubernetes.io/projected/ac76f4d2-9c49-4600-8286-67ba9e938edc-kube-api-access-722bw\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-systemd\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-lib-modules\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-netd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljwrj\" (UniqueName: \"kubernetes.io/projected/7b75f95f-6347-477e-acae-4bcbd156b602-kube-api-access-ljwrj\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615332    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-netns\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615357    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fq6d\" (UniqueName: \"kubernetes.io/projected/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-kube-api-access-9fq6d\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-var-lib-kubelet\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615432    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-netns\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-socket-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-env-overrides\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-socket-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-tuned\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80112fed-0ee5-429d-99cf-394966dfb15c-agent-certs\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-kubelet\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-node-log\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-system-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b75f95f-6347-477e-acae-4bcbd156b602-host\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysconfig\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysconfig\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-systemd\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.615959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-var-lib-kubelet\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616069    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-etc-selinux\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-lib-modules\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-sys\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac169c71-cf00-4dd4-b909-28a42d6132cb-tmp-dir\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-bin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.616869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-iptables-alerter-script\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-tmp\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b75f95f-6347-477e-acae-4bcbd156b602-serviceca\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616435    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616456    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-sys\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-dbus\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.616552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-kubelet\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-iptables-alerter-script\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-host-slash\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmw6\" (UniqueName: \"kubernetes.io/projected/164bd51a-d5ea-4708-a456-c9dab2b5d09c-kube-api-access-djmw6\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-slash\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-etc-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-multus-certs\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617352    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5w5\" (UniqueName: \"kubernetes.io/projected/d317b71a-743f-442d-a9c5-d2185037cdb4-kube-api-access-7h5w5\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-config\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.617664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-kubelet-config\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617422    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cnibin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-system-cni-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-device-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-log-socket\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-bin\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617573    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac169c71-cf00-4dd4-b909-28a42d6132cb-hosts-file\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-socket-dir-parent\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-cnibin\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-systemd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b46zx\" (UniqueName: \"kubernetes.io/projected/ac169c71-cf00-4dd4-b909-28a42d6132cb-kube-api-access-b46zx\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-hostroot\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-conf\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617749    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-ovn\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.618351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovn-node-metrics-cert\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cni-binary-copy\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-multus\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-conf-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-sys-fs\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-systemd-units\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80112fed-0ee5-429d-99cf-394966dfb15c-konnectivity-ca\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617947    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-script-lib\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.617969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-host-slash\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-system-cni-dir\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-conf\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-device-dir\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.619248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-cni-binary-copy\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.619939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d2f11-4da5-4f06-ad0f-4565081c8906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.619939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d317b71a-743f-442d-a9c5-d2185037cdb4-sys-fs\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:05.619939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d2f11-4da5-4f06-ad0f-4565081c8906-cnibin\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.619939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.618856    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-sysctl-d\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.619939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.619162    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80112fed-0ee5-429d-99cf-394966dfb15c-konnectivity-ca\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.620857 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.620790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-tmp\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.620857 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.620851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/164bd51a-d5ea-4708-a456-c9dab2b5d09c-etc-tuned\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.621709 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.621495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80112fed-0ee5-429d-99cf-394966dfb15c-agent-certs\") pod \"konnectivity-agent-7gn7f\" (UID: \"80112fed-0ee5-429d-99cf-394966dfb15c\") " pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:05.623284 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.623259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z88v\" (UniqueName: \"kubernetes.io/projected/6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb-kube-api-access-9z88v\") pod \"iptables-alerter-s5w6c\" (UID: \"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb\") " pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:05.623920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.623874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmf4l\" (UniqueName: \"kubernetes.io/projected/be7d2f11-4da5-4f06-ad0f-4565081c8906-kube-api-access-hmf4l\") pod \"multus-additional-cni-plugins-lqbfb\" (UID: \"be7d2f11-4da5-4f06-ad0f-4565081c8906\") " pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:05.625126 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.625102    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:05.625126 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.625129    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:05.625304 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.625141    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:05.625304 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:05.625215    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:06.125197147 +0000 UTC m=+3.053335646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:05.627666 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.627465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmw6\" (UniqueName: \"kubernetes.io/projected/164bd51a-d5ea-4708-a456-c9dab2b5d09c-kube-api-access-djmw6\") pod \"tuned-86ljz\" (UID: \"164bd51a-d5ea-4708-a456-c9dab2b5d09c\") " pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:05.629820 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:05.629793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5w5\" (UniqueName: \"kubernetes.io/projected/d317b71a-743f-442d-a9c5-d2185037cdb4-kube-api-access-7h5w5\") pod \"aws-ebs-csi-driver-node-79mj7\" (UID: \"d317b71a-743f-442d-a9c5-d2185037cdb4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:06.858379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858329    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-kubelet-config\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:06.858379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:06.858500    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cnibin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858538    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-kubelet-config\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:06.858581    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:07.358558273 +0000 UTC m=+3.146891840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-log-socket\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cnibin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.858646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-bin\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-log-socket\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac169c71-cf00-4dd4-b909-28a42d6132cb-hosts-file\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-socket-dir-parent\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858710    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-bin\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-systemd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b46zx\" (UniqueName: \"kubernetes.io/projected/ac169c71-cf00-4dd4-b909-28a42d6132cb-kube-api-access-b46zx\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-socket-dir-parent\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858761    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac169c71-cf00-4dd4-b909-28a42d6132cb-hosts-file\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858796    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-systemd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-hostroot\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-ovn\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovn-node-metrics-cert\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cni-binary-copy\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-hostroot\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-multus\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-ovn\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-conf-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-conf-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.858996    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-systemd-units\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-systemd-units\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-multus\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859155    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:06.859157    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:06.859216    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:07.359197961 +0000 UTC m=+3.147531519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-script-lib\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-os-release\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q29t\" (UniqueName: \"kubernetes.io/projected/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-kube-api-access-8q29t\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-k8s-cni-cncf-io\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-daemon-config\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.859781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-etc-kubernetes\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-var-lib-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-722bw\" (UniqueName: \"kubernetes.io/projected/ac76f4d2-9c49-4600-8286-67ba9e938edc-kube-api-access-722bw\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-netd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859494    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljwrj\" (UniqueName: \"kubernetes.io/projected/7b75f95f-6347-477e-acae-4bcbd156b602-kube-api-access-ljwrj\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-os-release\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-netns\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-cni-binary-copy\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-run-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-etc-kubernetes\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-cni-netd\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-netns\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fq6d\" (UniqueName: \"kubernetes.io/projected/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-kube-api-access-9fq6d\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-netns\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-env-overrides\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-kubelet\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.860621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859736    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-node-log\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859774    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-node-log\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859832    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-kubelet\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.859873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-run-netns\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-multus-daemon-config\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860059    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-k8s-cni-cncf-io\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-system-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-var-lib-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b75f95f-6347-477e-acae-4bcbd156b602-host\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-env-overrides\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac169c71-cf00-4dd4-b909-28a42d6132cb-tmp-dir\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-system-cni-dir\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-bin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860205    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b75f95f-6347-477e-acae-4bcbd156b602-serviceca\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b75f95f-6347-477e-acae-4bcbd156b602-host\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-dbus\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-kubelet\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-cni-bin\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.861314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-slash\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-etc-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860301    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-var-lib-kubelet\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-multus-certs\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-config\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-etc-openvswitch\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-host-slash\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-host-run-multus-certs\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac169c71-cf00-4dd4-b909-28a42d6132cb-tmp-dir\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0277b2e7-fe6e-427a-a3e5-99f8e813049b-dbus\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860640    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7b75f95f-6347-477e-acae-4bcbd156b602-serviceca\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.860797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-config\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.861150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovnkube-script-lib\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.862080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.861844    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-ovn-node-metrics-cert\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.871434 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.871390    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b46zx\" (UniqueName: \"kubernetes.io/projected/ac169c71-cf00-4dd4-b909-28a42d6132cb-kube-api-access-b46zx\") pod \"node-resolver-k25gn\" (UID: \"ac169c71-cf00-4dd4-b909-28a42d6132cb\") " pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:06.872017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.871989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q29t\" (UniqueName: \"kubernetes.io/projected/e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1-kube-api-access-8q29t\") pod \"ovnkube-node-lshbt\" (UID: \"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.872463 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.872440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-722bw\" (UniqueName: \"kubernetes.io/projected/ac76f4d2-9c49-4600-8286-67ba9e938edc-kube-api-access-722bw\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:06.872621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.872598    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljwrj\" (UniqueName: \"kubernetes.io/projected/7b75f95f-6347-477e-acae-4bcbd156b602-kube-api-access-ljwrj\") pod \"node-ca-h64xh\" (UID: \"7b75f95f-6347-477e-acae-4bcbd156b602\") " pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:06.872925 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.872902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fq6d\" (UniqueName: \"kubernetes.io/projected/5dacd5b1-e29d-447b-8cc8-d9816cc147b4-kube-api-access-9fq6d\") pod \"multus-dhv4x\" (UID: \"5dacd5b1-e29d-447b-8cc8-d9816cc147b4\") " pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:06.943706 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.943666    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lqbfb"
Jul 31 21:36:06.958261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.958219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7"
Jul 31 21:36:06.968468 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.968391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:06.975685 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.975646    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5w6c"
Jul 31 21:36:06.981829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.981779    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-86ljz"
Jul 31 21:36:06.990039 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.990013    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:06.997825 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:06.997799    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k25gn"
Jul 31 21:36:07.006472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.006440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h64xh"
Jul 31 21:36:07.014397 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.014370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhv4x"
Jul 31 21:36:07.363351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.363257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:07.363351 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.363301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.363388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363437    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363456    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363469    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363498    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363505    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363539    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:08.363517868 +0000 UTC m=+4.151851419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363561    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:08.36354838 +0000 UTC m=+4.151881931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:07.363592 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:07.363580    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:08.363569683 +0000 UTC m=+4.151903234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:07.690834 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.690738    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80112fed_0ee5_429d_99cf_394966dfb15c.slice/crio-dbf57c85521c1173d4c2233d10f65329b9049ac6afd0a1e7ec32827c5b3fe08c WatchSource:0}: Error finding container dbf57c85521c1173d4c2233d10f65329b9049ac6afd0a1e7ec32827c5b3fe08c: Status 404 returned error can't find the container with id dbf57c85521c1173d4c2233d10f65329b9049ac6afd0a1e7ec32827c5b3fe08c
Jul 31 21:36:07.691402 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.691357    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac169c71_cf00_4dd4_b909_28a42d6132cb.slice/crio-401c93dd1a53c72947366fa8062f4de946e70d7bc7463260c65e0906645166a8 WatchSource:0}: Error finding container 401c93dd1a53c72947366fa8062f4de946e70d7bc7463260c65e0906645166a8: Status 404 returned error can't find the container with id 401c93dd1a53c72947366fa8062f4de946e70d7bc7463260c65e0906645166a8
Jul 31 21:36:07.691944 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.691881    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:31:06 +0000 UTC" deadline="2028-02-01 01:23:48.577652587 +0000 UTC"
Jul 31 21:36:07.691944 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.691906    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13179h47m40.885750575s"
Jul 31 21:36:07.694081 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.694063    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7d2f11_4da5_4f06_ad0f_4565081c8906.slice/crio-4e177e86cb895ea843cda827d3fd1f1af85c9f7750fda3c5f7b9e0c98aafede4 WatchSource:0}: Error finding container 4e177e86cb895ea843cda827d3fd1f1af85c9f7750fda3c5f7b9e0c98aafede4: Status 404 returned error can't find the container with id 4e177e86cb895ea843cda827d3fd1f1af85c9f7750fda3c5f7b9e0c98aafede4
Jul 31 21:36:07.695219 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.695193    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b75f95f_6347_477e_acae_4bcbd156b602.slice/crio-83907fa64a4be6eb6715871d333db7f64ee9c45e79b86a5ea28b2c0853bcfa5a WatchSource:0}: Error finding container 83907fa64a4be6eb6715871d333db7f64ee9c45e79b86a5ea28b2c0853bcfa5a: Status 404 returned error can't find the container with id 83907fa64a4be6eb6715871d333db7f64ee9c45e79b86a5ea28b2c0853bcfa5a
Jul 31 21:36:07.695952 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.695835    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164bd51a_d5ea_4708_a456_c9dab2b5d09c.slice/crio-fef08e62d801eef82aef17d3a8acd493c9e214380e3aecd48cd6970e0456f44a WatchSource:0}: Error finding container fef08e62d801eef82aef17d3a8acd493c9e214380e3aecd48cd6970e0456f44a: Status 404 returned error can't find the container with id fef08e62d801eef82aef17d3a8acd493c9e214380e3aecd48cd6970e0456f44a
Jul 31 21:36:07.697298 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:07.697243    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28ad150_57f9_4eb7_8a4f_07bb7db9c3c1.slice/crio-bd4574aded1b8fd18162d5a5f6dfe9ea6539f4b52dabe6baeb846e564ec4c167 WatchSource:0}: Error finding container bd4574aded1b8fd18162d5a5f6dfe9ea6539f4b52dabe6baeb846e564ec4c167: Status 404 returned error can't find the container with id bd4574aded1b8fd18162d5a5f6dfe9ea6539f4b52dabe6baeb846e564ec4c167
Jul 31 21:36:07.765771 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.765739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhv4x" event={"ID":"5dacd5b1-e29d-447b-8cc8-d9816cc147b4","Type":"ContainerStarted","Data":"a345cf30b229ce506e345994e709c67becc819912d67878484a647b35624102f"}
Jul 31 21:36:07.766946 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.766919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"bd4574aded1b8fd18162d5a5f6dfe9ea6539f4b52dabe6baeb846e564ec4c167"}
Jul 31 21:36:07.768017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.767996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86ljz" event={"ID":"164bd51a-d5ea-4708-a456-c9dab2b5d09c","Type":"ContainerStarted","Data":"fef08e62d801eef82aef17d3a8acd493c9e214380e3aecd48cd6970e0456f44a"}
Jul 31 21:36:07.768971 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.768946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h64xh" event={"ID":"7b75f95f-6347-477e-acae-4bcbd156b602","Type":"ContainerStarted","Data":"83907fa64a4be6eb6715871d333db7f64ee9c45e79b86a5ea28b2c0853bcfa5a"}
Jul 31 21:36:07.771452 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.771428    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerStarted","Data":"4e177e86cb895ea843cda827d3fd1f1af85c9f7750fda3c5f7b9e0c98aafede4"}
Jul 31 21:36:07.773010 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.772984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k25gn" event={"ID":"ac169c71-cf00-4dd4-b909-28a42d6132cb","Type":"ContainerStarted","Data":"401c93dd1a53c72947366fa8062f4de946e70d7bc7463260c65e0906645166a8"}
Jul 31 21:36:07.774407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.774383    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gn7f" event={"ID":"80112fed-0ee5-429d-99cf-394966dfb15c","Type":"ContainerStarted","Data":"dbf57c85521c1173d4c2233d10f65329b9049ac6afd0a1e7ec32827c5b3fe08c"}
Jul 31 21:36:07.775697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.775679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7" event={"ID":"d317b71a-743f-442d-a9c5-d2185037cdb4","Type":"ContainerStarted","Data":"061d8874559f575b362e2d2d7d1de9fe52c1218b273b8b3ee38bf9d386f0cd48"}
Jul 31 21:36:07.777021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:07.777002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5w6c" event={"ID":"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb","Type":"ContainerStarted","Data":"2a64ee1e91b0f923d78eece71231501acb870fb49fd809e4560638b9199c2d00"}
Jul 31 21:36:08.370382 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.370272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:08.370382 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.370339    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:08.370382 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.370371    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:08.370661 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.370507    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:08.370661 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.370573    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:10.370554209 +0000 UTC m=+6.158887759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:08.371084 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371033    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:08.371185 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371130    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:10.37111235 +0000 UTC m=+6.159445901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:08.371260 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371222    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:08.371260 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371242    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:08.371260 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371256    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:08.371404 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.371298    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:10.371285985 +0000 UTC m=+6.159619539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:08.692306 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.692180    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:31:06 +0000 UTC" deadline="2028-04-24 17:12:25.991868276 +0000 UTC"
Jul 31 21:36:08.692306 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.692249    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15187h36m17.299623309s"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.751958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.752006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.752106    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.752521    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.752661    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:08.752827 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:08.752753    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:08.790695 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.790655    2568 generic.go:356] "Generic (PLEG): container finished" podID="56e00fe9e17bca71b844e02c2118b505" containerID="494771507c674091c1275e88b752c4ab868eb8f8f9e1c6983a53f67b11a0e921" exitCode=0
Jul 31 21:36:08.790902 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.790767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal" event={"ID":"56e00fe9e17bca71b844e02c2118b505","Type":"ContainerDied","Data":"494771507c674091c1275e88b752c4ab868eb8f8f9e1c6983a53f67b11a0e921"}
Jul 31 21:36:08.798781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:08.798746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal" event={"ID":"4933a03e6e601d67493ba375e1a2d98a","Type":"ContainerStarted","Data":"6923db05ec776984fec73bdb447d0f5d87692231e77d68b6379bd6b71d797f1f"}
Jul 31 21:36:09.821349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:09.821310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal" event={"ID":"56e00fe9e17bca71b844e02c2118b505","Type":"ContainerStarted","Data":"590041eded5386e3f51fbe84af8dac1b9ef85c474bbed2ab2ba755696e2fc8b1"}
Jul 31 21:36:09.840000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:09.838948    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-210.ec2.internal" podStartSLOduration=3.838916136 podStartE2EDuration="3.838916136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:08.824019609 +0000 UTC m=+4.612353185" watchObservedRunningTime="2026-07-31 21:36:09.838916136 +0000 UTC m=+5.627249713"
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.389604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.389696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.389735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.389912    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.389932    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.389944    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.390005    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:14.389985356 +0000 UTC m=+10.178318909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.390451    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.390504    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:14.390486638 +0000 UTC m=+10.178820190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.390563    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:10.390638 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.390594    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:14.390584002 +0000 UTC m=+10.178917559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:10.752725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.751948    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:10.752725 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.752094    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:10.752725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.752514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:10.752725 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.752607    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:10.755542 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:10.753162    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:10.755542 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:10.753274    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:12.751575 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:12.751529    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:12.751575 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:12.751560    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:12.752143 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:12.751682    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:12.752209 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:12.752189    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:12.752267 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:12.752243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:12.752352 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:12.752323    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:14.424395 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.424355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.424414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.424456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424559    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424592    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424638    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:22.424618198 +0000 UTC m=+18.212951756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424660    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:22.424649491 +0000 UTC m=+18.212983049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424702    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424727    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424742    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:14.424862 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.424794    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:22.424779507 +0000 UTC m=+18.213113057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.751504    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.751648    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.751705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.751833    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:14.751918    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:14.752109 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:14.751990    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:16.751328 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:16.751260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:16.751811 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:16.751260    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:16.751811 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:16.751406    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:16.751811 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:16.751416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:16.751811 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:16.751509    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:16.751811 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:16.751611    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:18.750779 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:18.750748    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:18.751179 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:18.750750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:18.751179 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:18.750901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:18.751179 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:18.750894    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:18.751179 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:18.751028    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:18.751179 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:18.751119    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:20.751781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:20.751725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:20.752273 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:20.751729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:20.752273 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:20.751897    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:20.752273 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:20.751740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:20.752273 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:20.751950    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:20.752273 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:20.752012    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:22.488050 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.487994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.488101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.488135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488154    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488237    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:36:38.488213354 +0000 UTC m=+34.276546908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488268    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488289    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488310    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488324    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488324    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:36:38.488310046 +0000 UTC m=+34.276643603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:22.488641 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.488374    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:38.48835993 +0000 UTC m=+34.276693481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:22.751468 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.751378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:22.751468 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.751404    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:22.751468 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:22.751378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:22.751746 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.751521    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:22.751746 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.751584    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:22.751746 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:22.751668    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:24.752259 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:24.752225    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:24.752738 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:24.752335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:24.752738 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:24.752337    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:24.752738 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:24.752366    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:24.752738 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:24.752462    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:24.752738 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:24.752553    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:26.751589 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.751275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:26.752356 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.751275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:26.752356 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:26.751696    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:26.752356 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.751277    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:26.752356 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:26.751762    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:26.752356 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:26.751879    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:26.859670 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.859636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"995d91142009cf98886776f9f65c68a1a8c2601e2d2fa08b8ff304a49ff03fd8"}
Jul 31 21:36:26.859844 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.859728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"821d97373cf1d14b6d2e2b1462a1d08aaa698a2a950e11ce0d65ffd0964f6bb4"}
Jul 31 21:36:26.859844 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.859780    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"fc875a413010136add79c0d087d94063cd62bfec46a5ee3bca0b3012fe991311"}
Jul 31 21:36:26.859951 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.859855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"3e3b92d65b5a0ebedf4616554eddab6b40800b5de3348d3cd3e35ef2e77ff684"}
Jul 31 21:36:26.861153 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.861129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-86ljz" event={"ID":"164bd51a-d5ea-4708-a456-c9dab2b5d09c","Type":"ContainerStarted","Data":"7a7fd8385c5349c449a5f66febff82cc1e49911263c9f2b26e0da859a8bb9a2e"}
Jul 31 21:36:26.862924 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.862900    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h64xh" event={"ID":"7b75f95f-6347-477e-acae-4bcbd156b602","Type":"ContainerStarted","Data":"18920aa13a0dd3e2ab91e43b0d0676deb8a1338e529190abed712194eb968ce1"}
Jul 31 21:36:26.864696 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.864669    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="fabba53bf670847665cb31588a3b3ee699d99de45b382e9f0007458e88b6a32c" exitCode=0
Jul 31 21:36:26.864863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.864751    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"fabba53bf670847665cb31588a3b3ee699d99de45b382e9f0007458e88b6a32c"}
Jul 31 21:36:26.866412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.866387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k25gn" event={"ID":"ac169c71-cf00-4dd4-b909-28a42d6132cb","Type":"ContainerStarted","Data":"e0515ec0e53ea35aa9734a546c6a2347d1859085b56b7afdabb82a77484d3ab3"}
Jul 31 21:36:26.868209 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.868184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7gn7f" event={"ID":"80112fed-0ee5-429d-99cf-394966dfb15c","Type":"ContainerStarted","Data":"e6b9d80cc61d7bf76275df788e0e153f68d25386af2aa729b9e3c8efb7a84a6d"}
Jul 31 21:36:26.869868 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.869844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7" event={"ID":"d317b71a-743f-442d-a9c5-d2185037cdb4","Type":"ContainerStarted","Data":"8c84099c85004a137a5036bd73f6339bf6d6af48ccf2092f07febfd294d27f5f"}
Jul 31 21:36:26.871327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.871305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhv4x" event={"ID":"5dacd5b1-e29d-447b-8cc8-d9816cc147b4","Type":"ContainerStarted","Data":"43dbe2027d62342d773080c6d128f6ad8f4d1b110aef86a78913e085f5537dc0"}
Jul 31 21:36:26.879087 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.879046    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-210.ec2.internal" podStartSLOduration=20.879030682 podStartE2EDuration="20.879030682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:09.84126324 +0000 UTC m=+5.629596817" watchObservedRunningTime="2026-07-31 21:36:26.879030682 +0000 UTC m=+22.667364254"
Jul 31 21:36:26.879348 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.879327    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-86ljz" podStartSLOduration=4.217599926 podStartE2EDuration="22.879318902s" totalImagesPullingTime="18.661718976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:26.87865088 +0000 UTC m=+22.666984454" watchObservedRunningTime="2026-07-31 21:36:26.879318902 +0000 UTC m=+22.667652475"
Jul 31 21:36:26.895697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.895644    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dhv4x" podStartSLOduration=3.205357651 podStartE2EDuration="21.895624778s" totalImagesPullingTime="18.690267127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:26.89514602 +0000 UTC m=+22.683479593" watchObservedRunningTime="2026-07-31 21:36:26.895624778 +0000 UTC m=+22.683958350"
Jul 31 21:36:26.943182 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.943129    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7gn7f" podStartSLOduration=4.333882783 podStartE2EDuration="22.943111176s" totalImagesPullingTime="18.609228393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:26.943005471 +0000 UTC m=+22.731339043" watchObservedRunningTime="2026-07-31 21:36:26.943111176 +0000 UTC m=+22.731444749"
Jul 31 21:36:26.962803 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.962717    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k25gn" podStartSLOduration=4.299541712 podStartE2EDuration="22.962701948s" totalImagesPullingTime="18.663160236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:26.962450234 +0000 UTC m=+22.750783811" watchObservedRunningTime="2026-07-31 21:36:26.962701948 +0000 UTC m=+22.751035521"
Jul 31 21:36:26.977998 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:26.977945    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h64xh" podStartSLOduration=3.372152227 podStartE2EDuration="21.977928038s" totalImagesPullingTime="18.605775811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:26.977449594 +0000 UTC m=+22.765783167" watchObservedRunningTime="2026-07-31 21:36:26.977928038 +0000 UTC m=+22.766261636"
Jul 31 21:36:27.745246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.745217    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 21:36:27.877617 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.877575    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"28ce7e78f485929c87bf881a628cb8d1a329474b1a56d4b0a0797e11fdd49d7e"}
Jul 31 21:36:27.878178 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.877709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"c2952382e491e0d92b93a3873871fdc41bb2b01ce9a9fe6857669683a7acd221"}
Jul 31 21:36:27.879884 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.879853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7" event={"ID":"d317b71a-743f-442d-a9c5-d2185037cdb4","Type":"ContainerStarted","Data":"d28dd5c0cd92baf5b7f6c2aefccfc89af58b5c292dbf1592e62ca04179b00350"}
Jul 31 21:36:27.881827 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.881563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5w6c" event={"ID":"6f4b03ee-c57b-4bdc-b859-1f7cce15c1bb","Type":"ContainerStarted","Data":"6c8a0ec9a67429ccdbb26011826744bfba57e75f8f0a700f735eb3ae0cd8a038"}
Jul 31 21:36:27.897206 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:27.897164    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5w6c" podStartSLOduration=5.231244409 podStartE2EDuration="23.897150283s" totalImagesPullingTime="18.665905874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:27.896800145 +0000 UTC m=+23.685133717" watchObservedRunningTime="2026-07-31 21:36:27.897150283 +0000 UTC m=+23.685483887"
Jul 31 21:36:28.730251 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.730127    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T21:36:27.745240434Z","UUID":"3af6532b-c2a4-410e-bb7c-714a2c74a18e","Handler":null,"Name":"","Endpoint":""}
Jul 31 21:36:28.731985 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.731802    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 21:36:28.731985 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.731879    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 21:36:28.751325 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.751299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:28.751487 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.751303    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:28.751487 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:28.751424    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:28.751487 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:28.751424    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:28.751655 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:28.751535    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:28.751655 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:28.751620    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:29.889755 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:29.889698    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7" event={"ID":"d317b71a-743f-442d-a9c5-d2185037cdb4","Type":"ContainerStarted","Data":"27ca5cdd0d8d76d3a733e6d9b886ca36e214949ce28eb5ba45b3bc20f50d6ee9"}
Jul 31 21:36:29.893069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:29.892860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"aa9041799e62cc7546f475cadee17f977d87547eed8d79f4823ced6f96c9153c"}
Jul 31 21:36:29.913018 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:29.912967    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-79mj7" podStartSLOduration=5.075969776 podStartE2EDuration="25.912951354s" totalImagesPullingTime="20.836981578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:29.912683588 +0000 UTC m=+25.701017163" watchObservedRunningTime="2026-07-31 21:36:29.912951354 +0000 UTC m=+25.701285008"
Jul 31 21:36:30.750736 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:30.750700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:30.750999 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:30.750850    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:30.750999 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:30.750903    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:30.751137 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:30.751024    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:30.751137 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:30.751058    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:30.751137 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:30.751126    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:31.531695 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.531567    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:31.533543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.532235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:31.535642 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.534390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:31.535642 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.534901    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7gn7f"
Jul 31 21:36:31.899116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.898894    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="7f016084dc7b0e4b69b03144052e3713bdd054b101775137e95ccaf6da60663c" exitCode=0
Jul 31 21:36:31.899317 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.898977    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"7f016084dc7b0e4b69b03144052e3713bdd054b101775137e95ccaf6da60663c"}
Jul 31 21:36:31.903404 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.903369    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" event={"ID":"e28ad150-57f9-4eb7-8a4f-07bb7db9c3c1","Type":"ContainerStarted","Data":"fbc28a7926198c4d963b373a567849db3d051e0a0efffc182c8d1f6764513b3e"}
Jul 31 21:36:31.951156 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:31.951105    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt" podStartSLOduration=9.245703231 podStartE2EDuration="27.951090014s" totalImagesPullingTime="18.705386783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:31.950802824 +0000 UTC m=+27.739136397" watchObservedRunningTime="2026-07-31 21:36:31.951090014 +0000 UTC m=+27.739423587"
Jul 31 21:36:32.753875 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.753834    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:32.754538 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:32.753974    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:32.754538 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.754443    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:32.754649 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:32.754538    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:32.754649 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.754596    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:32.754746 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:32.754676    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:32.906160 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.906123    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:32.906365 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.906190    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:32.906365 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.906226    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:32.922235 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.922209    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:32.922398 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:32.922317    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:36:33.495783 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.495743    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xm2fg"]
Jul 31 21:36:33.496037 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.495893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:33.496037 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:33.496015    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:33.505708 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.505672    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mxxvz"]
Jul 31 21:36:33.505847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.505778    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:33.505900 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:33.505881    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:33.508747 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.508714    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h7nkh"]
Jul 31 21:36:33.508926 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.508837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:33.508992 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:33.508924    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:33.909753 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.909721    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="291c1d9bb1f1e49997646160c1592cd3762194f0787c370a46920171f5c3f0ac" exitCode=0
Jul 31 21:36:33.910221 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:33.909798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"291c1d9bb1f1e49997646160c1592cd3762194f0787c370a46920171f5c3f0ac"}
Jul 31 21:36:34.751538 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:34.751502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:34.751538 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:34.751538    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:34.751828 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:34.751606    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:34.751828 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:34.751737    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:34.790518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:34.790463    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:34.890843 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:34.890802    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:35.751946 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:35.751231    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:35.751946 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:35.751614    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:35.916341 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:35.916309    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="8fac20374fa3e49b050e17e281e33ad696373a93ec8dee794f22c6d651cdb83d" exitCode=0
Jul 31 21:36:35.916506 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:35.916358    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"8fac20374fa3e49b050e17e281e33ad696373a93ec8dee794f22c6d651cdb83d"}
Jul 31 21:36:36.751064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:36.751024    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:36.751265 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:36.751175    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:36.751265 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:36.751227    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:36.751404 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:36.751380    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:36.809336 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:36.809294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:36.893046 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:36.893002    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:36.998211 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:36.998174    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:37.751362 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:37.751327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:37.751569 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:37.751448    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h7nkh" podUID="ac76f4d2-9c49-4600-8286-67ba9e938edc"
Jul 31 21:36:37.874630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:37.874589    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:37.976942 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:37.976907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:38.507511 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.507470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:38.507719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.507564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:38.507719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.507596    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:38.507719 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507652    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507720    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507740    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs podName:ac76f4d2-9c49-4600-8286-67ba9e938edc nodeName:}" failed. No retries permitted until 2026-07-31 21:37:10.507717268 +0000 UTC m=+66.296050838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs") pod "network-metrics-daemon-h7nkh" (UID: "ac76f4d2-9c49-4600-8286-67ba9e938edc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507763    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret podName:0277b2e7-fe6e-427a-a3e5-99f8e813049b nodeName:}" failed. No retries permitted until 2026-07-31 21:37:10.50774885 +0000 UTC m=+66.296082405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret") pod "global-pull-secret-syncer-xm2fg" (UID: "0277b2e7-fe6e-427a-a3e5-99f8e813049b") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507723    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507786    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507800    2568 projected.go:196] Error preparing data for projected volume kube-api-access-4tktp for pod openshift-network-diagnostics/network-check-target-mxxvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:38.507908 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.507854    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp podName:b12acf64-69f3-4ed4-98dc-6081ba4b9218 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:10.507844638 +0000 UTC m=+66.296178189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tktp" (UniqueName: "kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp") pod "network-check-target-mxxvz" (UID: "b12acf64-69f3-4ed4-98dc-6081ba4b9218") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:38.662296 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.662266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:38.722166 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.722111    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:38.750722 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.750681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:38.750722 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:38.750720    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:38.750949 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.750854    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xm2fg" podUID="0277b2e7-fe6e-427a-a3e5-99f8e813049b"
Jul 31 21:36:38.751026 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:38.750953    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mxxvz" podUID="b12acf64-69f3-4ed4-98dc-6081ba4b9218"
Jul 31 21:36:39.058308 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.058282    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-210.ec2.internal" event="NodeReady"
Jul 31 21:36:39.058845 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.058454    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 21:36:39.135322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.135237    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-499cx"]
Jul 31 21:36:39.138517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.138488    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.140981 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.140527    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6mfnb"]
Jul 31 21:36:39.142644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.142620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 21:36:39.143349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.143275    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 21:36:39.143349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.143294    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgwbq\""
Jul 31 21:36:39.143532 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.143282    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.145709 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.145689    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 21:36:39.145806 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.145780    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vzfj5\""
Jul 31 21:36:39.145891 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.145859    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 21:36:39.146116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.146097    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 21:36:39.158160 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.158119    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-499cx"]
Jul 31 21:36:39.158802 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.158782    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mfnb"]
Jul 31 21:36:39.293281 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.293246    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:39.315061 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b408572c-5e22-409f-b46f-d1dea8aa98c1-config-volume\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.315061 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b408572c-5e22-409f-b46f-d1dea8aa98c1-tmp-dir\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.315322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315099    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vll7t\" (UniqueName: \"kubernetes.io/projected/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-kube-api-access-vll7t\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.315322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-cert\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.315322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315228    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.315322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.315288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchqn\" (UniqueName: \"kubernetes.io/projected/b408572c-5e22-409f-b46f-d1dea8aa98c1-kube-api-access-hchqn\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.393065 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.392985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:39.416111 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b408572c-5e22-409f-b46f-d1dea8aa98c1-config-volume\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.416299 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b408572c-5e22-409f-b46f-d1dea8aa98c1-tmp-dir\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.416299 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vll7t\" (UniqueName: \"kubernetes.io/projected/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-kube-api-access-vll7t\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.416299 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-cert\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.416299 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.416507 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:39.416386    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:39.416507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchqn\" (UniqueName: \"kubernetes.io/projected/b408572c-5e22-409f-b46f-d1dea8aa98c1-kube-api-access-hchqn\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.416507 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:39.416450    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:39.916430029 +0000 UTC m=+35.704763589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:39.416660 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b408572c-5e22-409f-b46f-d1dea8aa98c1-tmp-dir\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.416734 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.416717    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b408572c-5e22-409f-b46f-d1dea8aa98c1-config-volume\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.421254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.421228    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-cert\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.425051 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.425005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchqn\" (UniqueName: \"kubernetes.io/projected/b408572c-5e22-409f-b46f-d1dea8aa98c1-kube-api-access-hchqn\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.425315 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.425242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vll7t\" (UniqueName: \"kubernetes.io/projected/da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed-kube-api-access-vll7t\") pod \"ingress-canary-6mfnb\" (UID: \"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed\") " pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.462134 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.462103    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mfnb"
Jul 31 21:36:39.751143 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.751053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:36:39.753519 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.753472    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 21:36:39.753519 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.753490    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl4n\""
Jul 31 21:36:39.921058 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:39.921017    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:39.921257 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:39.921213    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:39.921326 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:39.921312    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:40.921289629 +0000 UTC m=+36.709623183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:40.318856 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.318630    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mfnb"]
Jul 31 21:36:40.323908 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:40.323872    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda36a2fc_6c1b_41ec_b02f_2dbd028cc2ed.slice/crio-c081942a282accd49ba21563b757404950bf8c436a180f60eac80d1aa44685b1 WatchSource:0}: Error finding container c081942a282accd49ba21563b757404950bf8c436a180f60eac80d1aa44685b1: Status 404 returned error can't find the container with id c081942a282accd49ba21563b757404950bf8c436a180f60eac80d1aa44685b1
Jul 31 21:36:40.411194 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.411170    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:40.751743 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.751640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:36:40.751922 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.751806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:36:40.754092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.754068    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 21:36:40.754092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.754085    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r85f\""
Jul 31 21:36:40.754092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.754069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 21:36:40.754645 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.754624    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 21:36:40.928455 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.928429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:40.928637 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:40.928533    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:40.928637 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:40.928591    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:42.928570368 +0000 UTC m=+38.716904140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:40.932713 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.932683    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="248e607b1d3d7167d2c91060e8d1b0c98b67c1dd279f074fd0a53ab89846ea74" exitCode=0
Jul 31 21:36:40.932878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.932766    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"248e607b1d3d7167d2c91060e8d1b0c98b67c1dd279f074fd0a53ab89846ea74"}
Jul 31 21:36:40.934099 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:40.934063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mfnb" event={"ID":"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed","Type":"ContainerStarted","Data":"c081942a282accd49ba21563b757404950bf8c436a180f60eac80d1aa44685b1"}
Jul 31 21:36:41.418429 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.418333    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"]
Jul 31 21:36:41.421758 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.421729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.423901 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.423869    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:41.423901 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.423869    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:41.424111 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.423899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9dlm7\""
Jul 31 21:36:41.424111 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.423956    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 31 21:36:41.424220 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.424208    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 31 21:36:41.429711 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.429678    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"]
Jul 31 21:36:41.524533 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.524475    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"]
Jul 31 21:36:41.527683 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.527657    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.530276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.530248    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:41.530506 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.530489    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 31 21:36:41.530834 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.530799    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nxqjs\""
Jul 31 21:36:41.530957 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.530843    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:41.531192 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.531170    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-gqxf9"]
Jul 31 21:36:41.534069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.534042    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-serving-cert\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.534166 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.534148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw7rh\" (UniqueName: \"kubernetes.io/projected/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-kube-api-access-nw7rh\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.534233 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.534171    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58c9c7d678-8j8t8"]
Jul 31 21:36:41.534233 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.534191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-config\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.534800 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.534384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.536761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.536653    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6jdt6\""
Jul 31 21:36:41.536761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.536756    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 31 21:36:41.536945 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.536849    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 21:36:41.536945 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.536906    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 21:36:41.537137 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.537121    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 31 21:36:41.538109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.538070    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.539093 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.538804    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"]
Jul 31 21:36:41.541428 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541287    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 31 21:36:41.541428 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541304    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 21:36:41.541580 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541544    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 21:36:41.541963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541798    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 31 21:36:41.541963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541840    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 31 21:36:41.541963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.541849    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 31 21:36:41.542157 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.542000    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-px54w\""
Jul 31 21:36:41.543714 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.543695    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 31 21:36:41.549715 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.549682    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58c9c7d678-8j8t8"]
Jul 31 21:36:41.550172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.550148    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-gqxf9"]
Jul 31 21:36:41.619044 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.619005    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"]
Jul 31 21:36:41.624430 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.624394    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"
Jul 31 21:36:41.626639 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.626610    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:41.626639 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.626613    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:41.626849 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.626612    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qxzp9\""
Jul 31 21:36:41.632903 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.632707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"]
Jul 31 21:36:41.634618 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.634583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-serving-cert\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.634744 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.634636    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-snapshots\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.634744 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.634683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-default-certificate\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.634744 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.634714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-trusted-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.634937 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.634846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw7rh\" (UniqueName: \"kubernetes.io/projected/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-kube-api-access-nw7rh\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.635239 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635212    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.635333 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635310    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-service-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.635393 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-serving-cert\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.635393 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpff2\" (UniqueName: \"kubernetes.io/projected/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-kube-api-access-wpff2\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.635490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-stats-auth\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.635490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.635490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635472    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5x5\" (UniqueName: \"kubernetes.io/projected/d1475c67-dcf8-4a7d-bc10-73508e1ea642-kube-api-access-xw5x5\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.635611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-config\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.635611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635522    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfnjd\" (UniqueName: \"kubernetes.io/projected/d240ed71-83d7-4dac-80a1-0f600fb0af1e-kube-api-access-sfnjd\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.635611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635556    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-tmp\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.635611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.635579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.636148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.636101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-config\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.639399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.639356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-serving-cert\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.639693 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.639665    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-556bb5b8c4-c27gh"]
Jul 31 21:36:41.643042 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.643017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.645469 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.645429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 21:36:41.645469 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.645449    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 21:36:41.645737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.645476    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dbtts\""
Jul 31 21:36:41.645737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.645711    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 21:36:41.653482 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.653447    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 21:36:41.654394 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.654355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw7rh\" (UniqueName: \"kubernetes.io/projected/5df90cb2-d6c8-47c1-8a45-a12b74bfe74d-kube-api-access-nw7rh\") pod \"service-ca-operator-784f97bcf6-rs4l7\" (UID: \"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.655459 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.655432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556bb5b8c4-c27gh"]
Jul 31 21:36:41.725389 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.725308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:41.733144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.733109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"
Jul 31 21:36:41.735990 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.735960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpff2\" (UniqueName: \"kubernetes.io/projected/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-kube-api-access-wpff2\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.736140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.736140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.736140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-stats-auth\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.736140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736116    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8s9\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfnjd\" (UniqueName: \"kubernetes.io/projected/d240ed71-83d7-4dac-80a1-0f600fb0af1e-kube-api-access-sfnjd\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-tmp\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736370    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5sgn\" (UniqueName: \"kubernetes.io/projected/d97746e5-f26f-4c90-9bd4-7f894372613a-kube-api-access-d5sgn\") pod \"volume-data-source-validator-5b8776669-pxfgf\" (UID: \"d97746e5-f26f-4c90-9bd4-7f894372613a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-service-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-serving-cert\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5x5\" (UniqueName: \"kubernetes.io/projected/d1475c67-dcf8-4a7d-bc10-73508e1ea642-kube-api-access-xw5x5\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-tmp\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.737556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-snapshots\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-trusted-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-default-certificate\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.736687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.736731    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:42.236708858 +0000 UTC m=+38.025042409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.736809    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.736876    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:42.236859179 +0000 UTC m=+38.025192734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.736947    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.736976    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls podName:d240ed71-83d7-4dac-80a1-0f600fb0af1e nodeName:}" failed. No retries permitted until 2026-07-31 21:36:42.236966744 +0000 UTC m=+38.025300297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbrjt" (UID: "d240ed71-83d7-4dac-80a1-0f600fb0af1e") : secret "samples-operator-tls" not found
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.737488    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-service-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.738245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.737539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-snapshots\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.738710 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.738265    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-trusted-ca-bundle\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.739349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.739326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-stats-auth\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.739458 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.739385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-serving-cert\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.740127 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.740106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-default-certificate\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.745484 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.745457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5x5\" (UniqueName: \"kubernetes.io/projected/d1475c67-dcf8-4a7d-bc10-73508e1ea642-kube-api-access-xw5x5\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:41.745679 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.745499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfnjd\" (UniqueName: \"kubernetes.io/projected/d240ed71-83d7-4dac-80a1-0f600fb0af1e-kube-api-access-sfnjd\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:41.746102 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.746068    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpff2\" (UniqueName: \"kubernetes.io/projected/d539e0ff-ebd8-458e-9c80-4f2ab502ae14-kube-api-access-wpff2\") pod \"insights-operator-77696685b-gqxf9\" (UID: \"d539e0ff-ebd8-458e-9c80-4f2ab502ae14\") " pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.788319 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.788268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:41.838227 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.837970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.838091    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.838314    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8s9\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:41.838386    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:42.338354324 +0000 UTC m=+38.126687879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.838604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5sgn\" (UniqueName: \"kubernetes.io/projected/d97746e5-f26f-4c90-9bd4-7f894372613a-kube-api-access-d5sgn\") pod \"volume-data-source-validator-5b8776669-pxfgf\" (UID: \"d97746e5-f26f-4c90-9bd4-7f894372613a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"
Jul 31 21:36:41.839186 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.839186 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.838691    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.839936 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.839632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.840324 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.840283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.840795 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.840772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.842967 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.842944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.843496 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.843474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.846783 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.846732    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.847109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.847062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8s9\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:41.847220 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.847116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5sgn\" (UniqueName: \"kubernetes.io/projected/d97746e5-f26f-4c90-9bd4-7f894372613a-kube-api-access-d5sgn\") pod \"volume-data-source-validator-5b8776669-pxfgf\" (UID: \"d97746e5-f26f-4c90-9bd4-7f894372613a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"
Jul 31 21:36:41.851766 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.851732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-gqxf9"
Jul 31 21:36:41.882963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.882926    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7"]
Jul 31 21:36:41.935572 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.935546    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"
Jul 31 21:36:41.941470 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.941438    2568 generic.go:356] "Generic (PLEG): container finished" podID="be7d2f11-4da5-4f06-ad0f-4565081c8906" containerID="609f0c8451149ee1c13634828448c0ab1fb98153f1bda498971cac2c702b20f7" exitCode=0
Jul 31 21:36:41.941570 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:41.941505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerDied","Data":"609f0c8451149ee1c13634828448c0ab1fb98153f1bda498971cac2c702b20f7"}
Jul 31 21:36:42.242949 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.242913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:42.243155 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.243083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:42.243155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.243108    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 21:36:42.243259 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.243185    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls podName:d240ed71-83d7-4dac-80a1-0f600fb0af1e nodeName:}" failed. No retries permitted until 2026-07-31 21:36:43.243165605 +0000 UTC m=+39.031499224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbrjt" (UID: "d240ed71-83d7-4dac-80a1-0f600fb0af1e") : secret "samples-operator-tls" not found
Jul 31 21:36:42.243259 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.243196    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:42.243259 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.243211    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:43.243195924 +0000 UTC m=+39.031529481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:42.243259 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.243257    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:43.243243738 +0000 UTC m=+39.031577312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:42.243499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.243118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:42.344242 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.344194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:42.344414 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.344395    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:42.344462 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.344420    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:42.344508 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.344493    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:43.344470387 +0000 UTC m=+39.132803941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:42.552931 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:42.552897    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df90cb2_d6c8_47c1_8a45_a12b74bfe74d.slice/crio-266b1bdae88dabc252d88cec8f2dc4538f200930a2ac8d298930b57a3c1d0edf WatchSource:0}: Error finding container 266b1bdae88dabc252d88cec8f2dc4538f200930a2ac8d298930b57a3c1d0edf: Status 404 returned error can't find the container with id 266b1bdae88dabc252d88cec8f2dc4538f200930a2ac8d298930b57a3c1d0edf
Jul 31 21:36:42.704433 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.704401    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-gqxf9"]
Jul 31 21:36:42.707879 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.707845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf"]
Jul 31 21:36:42.708438 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:42.708416    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd539e0ff_ebd8_458e_9c80_4f2ab502ae14.slice/crio-b607157ddde1054de8c31c696fd4f05b654946e876407b2cc9c142d9d17c424d WatchSource:0}: Error finding container b607157ddde1054de8c31c696fd4f05b654946e876407b2cc9c142d9d17c424d: Status 404 returned error can't find the container with id b607157ddde1054de8c31c696fd4f05b654946e876407b2cc9c142d9d17c424d
Jul 31 21:36:42.711494 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:36:42.711461    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97746e5_f26f_4c90_9bd4_7f894372613a.slice/crio-ef23d33be5e300fd6ff2bd94292253294c830ff1d489f327dccdd4fb42b30fcb WatchSource:0}: Error finding container ef23d33be5e300fd6ff2bd94292253294c830ff1d489f327dccdd4fb42b30fcb: Status 404 returned error can't find the container with id ef23d33be5e300fd6ff2bd94292253294c830ff1d489f327dccdd4fb42b30fcb
Jul 31 21:36:42.945463 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.945256    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7" event={"ID":"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d","Type":"ContainerStarted","Data":"266b1bdae88dabc252d88cec8f2dc4538f200930a2ac8d298930b57a3c1d0edf"}
Jul 31 21:36:42.946354 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.946326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gqxf9" event={"ID":"d539e0ff-ebd8-458e-9c80-4f2ab502ae14","Type":"ContainerStarted","Data":"b607157ddde1054de8c31c696fd4f05b654946e876407b2cc9c142d9d17c424d"}
Jul 31 21:36:42.949491 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.949462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" event={"ID":"be7d2f11-4da5-4f06-ad0f-4565081c8906","Type":"ContainerStarted","Data":"700c7a5f4279cdd7022972ecf18d829e2f213460c64a70beb73cff4c9fbcaa9e"}
Jul 31 21:36:42.949665 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.949642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:42.949842 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.949809    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:42.949967 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:42.949901    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:46.949881743 +0000 UTC m=+42.738215306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:42.950733 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.950713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf" event={"ID":"d97746e5-f26f-4c90-9bd4-7f894372613a","Type":"ContainerStarted","Data":"ef23d33be5e300fd6ff2bd94292253294c830ff1d489f327dccdd4fb42b30fcb"}
Jul 31 21:36:42.952105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.952086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mfnb" event={"ID":"da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed","Type":"ContainerStarted","Data":"1af55f8bacbfaf6f5906da3e673a43df83080fc8241967efa5cf36259308ef7b"}
Jul 31 21:36:42.973049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.973004    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lqbfb" podStartSLOduration=9.239195337 podStartE2EDuration="38.972986537s" totalImagesPullingTime="29.7337912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:42.971728639 +0000 UTC m=+38.760062209" watchObservedRunningTime="2026-07-31 21:36:42.972986537 +0000 UTC m=+38.761320111"
Jul 31 21:36:42.987681 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:42.987636    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6mfnb" podStartSLOduration=1.690504603 podStartE2EDuration="3.987619861s" totalImagesPullingTime="2.297115258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:42.986753212 +0000 UTC m=+38.775086786" watchObservedRunningTime="2026-07-31 21:36:42.987619861 +0000 UTC m=+38.775953431"
Jul 31 21:36:43.100454 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.100317    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:43.161329 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.161290    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:43.252311 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.252273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:43.252508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.252333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:43.252508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.252372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:43.252508 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.252443    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:43.252645 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.252520    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:45.252494508 +0000 UTC m=+41.040828060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:43.252645 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.252532    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 21:36:43.252645 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.252550    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:45.252540178 +0000 UTC m=+41.040873736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:43.252645 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.252582    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls podName:d240ed71-83d7-4dac-80a1-0f600fb0af1e nodeName:}" failed. No retries permitted until 2026-07-31 21:36:45.252566146 +0000 UTC m=+41.040899726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbrjt" (UID: "d240ed71-83d7-4dac-80a1-0f600fb0af1e") : secret "samples-operator-tls" not found
Jul 31 21:36:43.353301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.353196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:43.353487 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.353468    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:43.353560 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.353490    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:43.353560 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:43.353557    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:45.353538424 +0000 UTC m=+41.141871992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:43.937577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.937542    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:43.996476 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:43.996439    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:45.269261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.269227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:45.269261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.269277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.269304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.269400    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.269427    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.269472    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.269444336 +0000 UTC m=+45.057777889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.269495    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.269485483 +0000 UTC m=+45.057819035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:45.269743 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.269506    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls podName:d240ed71-83d7-4dac-80a1-0f600fb0af1e nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.26950067 +0000 UTC m=+45.057834221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbrjt" (UID: "d240ed71-83d7-4dac-80a1-0f600fb0af1e") : secret "samples-operator-tls" not found
Jul 31 21:36:45.369943 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.369910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:45.370102 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.370062    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:45.370102 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.370080    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:45.370197 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:45.370133    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.370116618 +0000 UTC m=+45.158450169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:45.963321 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.963232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gqxf9" event={"ID":"d539e0ff-ebd8-458e-9c80-4f2ab502ae14","Type":"ContainerStarted","Data":"46b42f52b29114d4b11becf9565545ec928abffc5122d76104a51763f2f41e1a"}
Jul 31 21:36:45.966660 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.966589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf" event={"ID":"d97746e5-f26f-4c90-9bd4-7f894372613a","Type":"ContainerStarted","Data":"05065e47c6be08f0035192964a41a3a399d157b48cff9c7477ae6c044322924d"}
Jul 31 21:36:45.970399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.970357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7" event={"ID":"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d","Type":"ContainerStarted","Data":"0a51782387fa4895a037868148f89e633c765cbcb6ea6995773bea9d896801c8"}
Jul 31 21:36:45.981081 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.981033    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-gqxf9" podStartSLOduration=1.930779233 podStartE2EDuration="4.98101684s" totalImagesPullingTime="3.050237607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:45.979979175 +0000 UTC m=+41.768312748" watchObservedRunningTime="2026-07-31 21:36:45.98101684 +0000 UTC m=+41.769350413"
Jul 31 21:36:45.997083 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:45.997023    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7" podStartSLOduration=1.796447674 podStartE2EDuration="4.997000495s" totalImagesPullingTime="3.200552821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:45.995718692 +0000 UTC m=+41.784052266" watchObservedRunningTime="2026-07-31 21:36:45.997000495 +0000 UTC m=+41.785334066"
Jul 31 21:36:46.013381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:46.013319    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pxfgf" podStartSLOduration=1.970740862 podStartE2EDuration="5.01329847s" totalImagesPullingTime="3.042557608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:46.012258831 +0000 UTC m=+41.800592409" watchObservedRunningTime="2026-07-31 21:36:46.01329847 +0000 UTC m=+41.801632043"
Jul 31 21:36:46.131313 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:46.131214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:46.192080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:46.192050    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:46.983675 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:46.983637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:46.984183 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:46.983792    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:46.984183 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:46.983878    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:54.983860335 +0000 UTC m=+50.772193903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:47.341310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.341268    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:47.495761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.495724    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:47.716515 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.716435    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vw6jd"]
Jul 31 21:36:47.721798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.721767    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:47.743660 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.743619    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vw6jd"]
Jul 31 21:36:47.743863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.743774    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.746567 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.746541    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 21:36:47.746916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.746895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zkn8l\""
Jul 31 21:36:47.746916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.746909    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 21:36:47.788906 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.788862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-crio-socket\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.789066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.788922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjl5\" (UniqueName: \"kubernetes.io/projected/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-api-access-bpjl5\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.789066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.789021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-data-volume\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.789066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.789059    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.789264 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.789080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.809451 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.809419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:47.889579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-crio-socket\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjl5\" (UniqueName: \"kubernetes.io/projected/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-api-access-bpjl5\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889753 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-data-volume\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889753 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889658    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889753 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889888 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.889751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-crio-socket\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.889888 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:47.889766    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 21:36:47.889888 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:47.889845    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:48.389807668 +0000 UTC m=+44.178141239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : configmap "kube-rbac-proxy" not found
Jul 31 21:36:47.889982 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:47.889885    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:47.889982 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:47.889948    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:48.389928068 +0000 UTC m=+44.178261634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:47.890044 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.890027    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-data-volume\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:47.900681 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:47.900658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjl5\" (UniqueName: \"kubernetes.io/projected/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-api-access-bpjl5\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:48.015831 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.015784    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:48.116072 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.116039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:48.392916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.392803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:48.392916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.392878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:48.392916 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:48.392907    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 21:36:48.393132 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:48.392974    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.392957576 +0000 UTC m=+45.181291127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : configmap "kube-rbac-proxy" not found
Jul 31 21:36:48.393132 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:48.393025    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:48.393132 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:48.393078    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:49.39306638 +0000 UTC m=+45.181399931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:48.764015 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.763980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:48.842504 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:48.842469    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:49.300663 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.300629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.300675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.300701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.300784    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.300803    2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.300836    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.300805186 +0000 UTC m=+53.089138737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.300863    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.300853802 +0000 UTC m=+53.089187354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:49.301155 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.300884    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls podName:d240ed71-83d7-4dac-80a1-0f600fb0af1e nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.300875391 +0000 UTC m=+53.089208941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-zbrjt" (UID: "d240ed71-83d7-4dac-80a1-0f600fb0af1e") : secret "samples-operator-tls" not found
Jul 31 21:36:49.401347 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.401313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:49.401522 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.401365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:49.401522 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.401393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:49.401522 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401471    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:49.401522 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401485    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:49.401712 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401517    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 21:36:49.401712 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401536    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.401516657 +0000 UTC m=+53.189850226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:49.401712 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401582    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:51.401564599 +0000 UTC m=+47.189898167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : configmap "kube-rbac-proxy" not found
Jul 31 21:36:49.401712 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401590    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:49.401712 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:49.401632    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:51.401620788 +0000 UTC m=+47.189954340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:49.504714 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.504679    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:49.576175 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.576085    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:49.652139 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:49.652107    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:50.060403 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:50.060374    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k25gn_ac169c71-cf00-4dd4-b909-28a42d6132cb/dns-node-resolver/0.log"
Jul 31 21:36:50.566480 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:50.566446    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:50.862853 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:50.862751    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h64xh_7b75f95f-6347-477e-acae-4bcbd156b602/node-ca/0.log"
Jul 31 21:36:51.116611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:51.116529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:51.417316 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:51.417214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:51.417316 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:51.417260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:51.417520 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:51.417464    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:51.417561 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:51.417537    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:55.417517995 +0000 UTC m=+51.205851555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:51.417791 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:51.417771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:51.660940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:51.660907    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mfnb_da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed/serve-healthcheck-canary/0.log"
Jul 31 21:36:53.783761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:53.783724    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:53.860649 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:53.860600    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:53.973467 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:53.973429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:54.831909 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:54.831876    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:55.001566 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.001536    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:55.050894 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.050846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:36:55.051070 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:55.050989    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:55.051070 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:55.051055    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls podName:b408572c-5e22-409f-b46f-d1dea8aa98c1 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:11.051039266 +0000 UTC m=+66.839372816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls") pod "dns-default-499cx" (UID: "b408572c-5e22-409f-b46f-d1dea8aa98c1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:55.102654 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.102568    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:55.215607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.215574    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:55.303656 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.303626    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:55.453508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.453419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:36:55.453671 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:55.453559    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:55.453671 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:55.453628    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls podName:b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:03.453612867 +0000 UTC m=+59.241946417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vw6jd" (UID: "b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:55.932066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:55.932028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:56.533301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:56.533272    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:56.726011 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:56.725980    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:56.923402 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:56.923319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:57.133520 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.133483    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:57.374979 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.374937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:57.374979 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.374985    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:36:57.375204 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.375089    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:13.375074634 +0000 UTC m=+69.163408186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : configmap references non-existent config key: service-ca.crt
Jul 31 21:36:57.375204 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.375089    2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 21:36:57.375204 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.375107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:57.375204 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.375148    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs podName:d1475c67-dcf8-4a7d-bc10-73508e1ea642 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:13.375133213 +0000 UTC m=+69.163466764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs") pod "router-default-58c9c7d678-8j8t8" (UID: "d1475c67-dcf8-4a7d-bc10-73508e1ea642") : secret "router-metrics-certs-default" not found
Jul 31 21:36:57.377508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.377479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d240ed71-83d7-4dac-80a1-0f600fb0af1e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-zbrjt\" (UID: \"d240ed71-83d7-4dac-80a1-0f600fb0af1e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:57.440045 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.440006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"
Jul 31 21:36:57.476310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.476279    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") pod \"image-registry-556bb5b8c4-c27gh\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") " pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:36:57.476459 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.476423    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 21:36:57.476459 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.476447    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-556bb5b8c4-c27gh: secret "image-registry-tls" not found
Jul 31 21:36:57.476539 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:36:57.476522    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls podName:17abc545-2d0b-4693-9e33-e77a5b9e2965 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:13.476499564 +0000 UTC m=+69.264833133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls") pod "image-registry-556bb5b8c4-c27gh" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965") : secret "image-registry-tls" not found
Jul 31 21:36:57.592117 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:57.592078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt"]
Jul 31 21:36:58.002093 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.002058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt" event={"ID":"d240ed71-83d7-4dac-80a1-0f600fb0af1e","Type":"ContainerStarted","Data":"5d769b0213608273474e50d8d984b92fbb811808a5a88638e73f31c9dfdcaa7e"}
Jul 31 21:36:58.238633 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.238585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:58.340278 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.340183    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:58.530691 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.530654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:58.584389 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.584353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:58.726336 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.726254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:58.929752 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:58.929719    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:59.130362 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:59.130326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:36:59.230775 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:36:59.230741    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:00.010232 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.010192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt" event={"ID":"d240ed71-83d7-4dac-80a1-0f600fb0af1e","Type":"ContainerStarted","Data":"33301b5a0a226f9d467d70396f0135d464a602a59fa47e6d03fc0da6087baccb"}
Jul 31 21:37:00.010737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.010252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt" event={"ID":"d240ed71-83d7-4dac-80a1-0f600fb0af1e","Type":"ContainerStarted","Data":"f3fd98bfcc496595860e1538274bacf24e63758f4f5b075bfda7c75ad5995fc2"}
Jul 31 21:37:00.027788 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.027736    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-zbrjt" podStartSLOduration=17.436739812 podStartE2EDuration="19.027720211s" totalImagesPullingTime="1.590980399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:00.026719178 +0000 UTC m=+55.815052751" watchObservedRunningTime="2026-07-31 21:37:00.027720211 +0000 UTC m=+55.816053801"
Jul 31 21:37:00.333418 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.333326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:00.550009 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.549978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:00.728559 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.728476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:00.941864 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:00.941800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:01.117346 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:01.117309    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:01.180997 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:01.180968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:02.337169 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:02.337130    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:02.396594 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:02.396561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:02.532558 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:02.532521    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:02.731334 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:02.731250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:02.935849 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:02.935792    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:03.130957 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.130918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:03.531329 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.531292    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:37:03.533664 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.533641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vw6jd\" (UID: \"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945\") " pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:37:03.654693 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.654653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vw6jd"
Jul 31 21:37:03.755891 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.755853    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:03.785643 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.785557    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vw6jd"]
Jul 31 21:37:03.788989 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:03.788959    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48e8d8d_56dc_4ddf_8c5b_97bca3fd8945.slice/crio-e67a4d434bcc2ff29489f960cee6adcbbf7f8baf087118c43722d488cff7ab50 WatchSource:0}: Error finding container e67a4d434bcc2ff29489f960cee6adcbbf7f8baf087118c43722d488cff7ab50: Status 404 returned error can't find the container with id e67a4d434bcc2ff29489f960cee6adcbbf7f8baf087118c43722d488cff7ab50
Jul 31 21:37:03.811331 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:03.811302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:04.025526 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.025492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vw6jd" event={"ID":"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945","Type":"ContainerStarted","Data":"2d262125b6f4f05da248ca0ceb84163652f05ac11a90a5044a5977a68abd5461"}
Jul 31 21:37:04.025692 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.025556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vw6jd" event={"ID":"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945","Type":"ContainerStarted","Data":"e67a4d434bcc2ff29489f960cee6adcbbf7f8baf087118c43722d488cff7ab50"}
Jul 31 21:37:04.334670 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.334634    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:04.528100 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.528065    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:04.730941 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.730860    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:04.927472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.927430    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:04.929206 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:04.929187    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lshbt"
Jul 31 21:37:05.130630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:05.130595    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:05.533570 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:05.533527    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:06.034909 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:06.034857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vw6jd" event={"ID":"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945","Type":"ContainerStarted","Data":"35b2bfcc5e1c44948d0beca2e0292d4e9a3dddbc6530c9aff2f41d4232ee2669"}
Jul 31 21:37:07.040596 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:07.040556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vw6jd" event={"ID":"b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945","Type":"ContainerStarted","Data":"99f45402d10457a0a9998460267f7e745cb5aae6adb4afed93eea734d75301b4"}
Jul 31 21:37:07.059217 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:07.059158    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vw6jd" podStartSLOduration=17.772235114 podStartE2EDuration="20.059139379s" totalImagesPullingTime="2.286904265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:07.058380249 +0000 UTC m=+62.846713821" watchObservedRunningTime="2026-07-31 21:37:07.059139379 +0000 UTC m=+62.847472951"
Jul 31 21:37:10.560397 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.560363    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-556bb5b8c4-c27gh"]
Jul 31 21:37:10.560782 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:37:10.560601    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh" podUID="17abc545-2d0b-4693-9e33-e77a5b9e2965"
Jul 31 21:37:10.590741 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.590702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:37:10.590934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.590759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:37:10.590934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.590838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:37:10.593405 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.593379    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 21:37:10.593705 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.593688    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 21:37:10.593705 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.593701    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 21:37:10.604171 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.604147    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0277b2e7-fe6e-427a-a3e5-99f8e813049b-original-pull-secret\") pod \"global-pull-secret-syncer-xm2fg\" (UID: \"0277b2e7-fe6e-427a-a3e5-99f8e813049b\") " pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:37:10.604297 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.604188    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 21:37:10.604297 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.604249    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac76f4d2-9c49-4600-8286-67ba9e938edc-metrics-certs\") pod \"network-metrics-daemon-h7nkh\" (UID: \"ac76f4d2-9c49-4600-8286-67ba9e938edc\") " pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:37:10.614770 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.614744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tktp\" (UniqueName: \"kubernetes.io/projected/b12acf64-69f3-4ed4-98dc-6081ba4b9218-kube-api-access-4tktp\") pod \"network-check-target-mxxvz\" (UID: \"b12acf64-69f3-4ed4-98dc-6081ba4b9218\") " pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:37:10.632334 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.632310    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"]
Jul 31 21:37:10.637018 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.637002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.647457 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.647434    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:10.657833 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.657787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"]
Jul 31 21:37:10.664255 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.664234    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl4n\""
Jul 31 21:37:10.672123 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.672104    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h7nkh"
Jul 31 21:37:10.692109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/864b0c52-921b-4e23-94af-f957667f5a65-ca-trust-extracted\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-registry-certificates\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-trusted-ca\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692328 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-registry-tls\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692328 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-bound-sa-token\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692414 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-image-registry-private-configuration\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692414 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692384    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-installation-pull-secrets\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.692414 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.692401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmx4\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-kube-api-access-tgmx4\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.761838 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.761787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xm2fg"
Jul 31 21:37:10.772256 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.772226    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r85f\""
Jul 31 21:37:10.776972 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.776950    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:37:10.793561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-registry-tls\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-bound-sa-token\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-image-registry-private-configuration\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-installation-pull-secrets\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmx4\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-kube-api-access-tgmx4\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/864b0c52-921b-4e23-94af-f957667f5a65-ca-trust-extracted\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-registry-certificates\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.793934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.793750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-trusted-ca\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.794539 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.794511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/864b0c52-921b-4e23-94af-f957667f5a65-ca-trust-extracted\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.794991 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.794968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-registry-certificates\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.795401 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.795367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/864b0c52-921b-4e23-94af-f957667f5a65-trusted-ca\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.796375 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.796353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-registry-tls\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.796638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.796622    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-image-registry-private-configuration\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.797479 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.797460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/864b0c52-921b-4e23-94af-f957667f5a65-installation-pull-secrets\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.812095 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.812025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmx4\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-kube-api-access-tgmx4\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.817151 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.816896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/864b0c52-921b-4e23-94af-f957667f5a65-bound-sa-token\") pod \"image-registry-bc8d6c5c5-5jw8x\" (UID: \"864b0c52-921b-4e23-94af-f957667f5a65\") " pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.822886 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.822855    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h7nkh"]
Jul 31 21:37:10.824640 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:10.824604    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac76f4d2_9c49_4600_8286_67ba9e938edc.slice/crio-bcf70de73f986dba475f24b1d7be6e4ac5cf05d169d252ca31037f5b69ec86ed WatchSource:0}: Error finding container bcf70de73f986dba475f24b1d7be6e4ac5cf05d169d252ca31037f5b69ec86ed: Status 404 returned error can't find the container with id bcf70de73f986dba475f24b1d7be6e4ac5cf05d169d252ca31037f5b69ec86ed
Jul 31 21:37:10.846223 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.846145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:10.931611 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:10.931573    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0277b2e7_fe6e_427a_a3e5_99f8e813049b.slice/crio-1d76b60b76efe3682a6466ed0f441ebb311e0385d6fd87d1f99053eacb60868a WatchSource:0}: Error finding container 1d76b60b76efe3682a6466ed0f441ebb311e0385d6fd87d1f99053eacb60868a: Status 404 returned error can't find the container with id 1d76b60b76efe3682a6466ed0f441ebb311e0385d6fd87d1f99053eacb60868a
Jul 31 21:37:10.933403 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.933382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xm2fg"]
Jul 31 21:37:10.948398 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.948370    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dbtts\""
Jul 31 21:37:10.956240 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.956147    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:10.957369 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:10.957344    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mxxvz"]
Jul 31 21:37:10.959985 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:10.959962    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12acf64_69f3_4ed4_98dc_6081ba4b9218.slice/crio-5e864a243485777f4e0ffb4b10be00d79c546528940bbccda84ac402b4054104 WatchSource:0}: Error finding container 5e864a243485777f4e0ffb4b10be00d79c546528940bbccda84ac402b4054104: Status 404 returned error can't find the container with id 5e864a243485777f4e0ffb4b10be00d79c546528940bbccda84ac402b4054104
Jul 31 21:37:11.021332 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.021290    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:11.056474 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.056430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mxxvz" event={"ID":"b12acf64-69f3-4ed4-98dc-6081ba4b9218","Type":"ContainerStarted","Data":"5e864a243485777f4e0ffb4b10be00d79c546528940bbccda84ac402b4054104"}
Jul 31 21:37:11.057772 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.057740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xm2fg" event={"ID":"0277b2e7-fe6e-427a-a3e5-99f8e813049b","Type":"ContainerStarted","Data":"1d76b60b76efe3682a6466ed0f441ebb311e0385d6fd87d1f99053eacb60868a"}
Jul 31 21:37:11.059021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.058991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7nkh" event={"ID":"ac76f4d2-9c49-4600-8286-67ba9e938edc","Type":"ContainerStarted","Data":"bcf70de73f986dba475f24b1d7be6e4ac5cf05d169d252ca31037f5b69ec86ed"}
Jul 31 21:37:11.059117 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.059006    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:37:11.082123 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.082091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:37:11.096326 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.096290    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:37:11.098776 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.098746    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b408572c-5e22-409f-b46f-d1dea8aa98c1-metrics-tls\") pod \"dns-default-499cx\" (UID: \"b408572c-5e22-409f-b46f-d1dea8aa98c1\") " pod="openshift-dns/dns-default-499cx"
Jul 31 21:37:11.134140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.134097    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:11.141498 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.141449    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"]
Jul 31 21:37:11.146639 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:11.146602    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864b0c52_921b_4e23_94af_f957667f5a65.slice/crio-dba04e45356a6448e9b67df24cbfc9dda5936a857d2cdc2f837a7719903f1cb0 WatchSource:0}: Error finding container dba04e45356a6448e9b67df24cbfc9dda5936a857d2cdc2f837a7719903f1cb0: Status 404 returned error can't find the container with id dba04e45356a6448e9b67df24cbfc9dda5936a857d2cdc2f837a7719903f1cb0
Jul 31 21:37:11.196626 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.196598    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.196784 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.196642    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.196784 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.196673    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.196784 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.196701    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.196784 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.196723    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.197270 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.197191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm8s9\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.197270 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.197262    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted\") pod \"17abc545-2d0b-4693-9e33-e77a5b9e2965\" (UID: \"17abc545-2d0b-4693-9e33-e77a5b9e2965\") "
Jul 31 21:37:11.197447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.197374    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:37:11.197689 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.197659    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:37:11.197950 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.197923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:37:11.198196 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.198177    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-certificates\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.199779 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.199744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:37:11.199914 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.199892    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:37:11.199972 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.199941    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9" (OuterVolumeSpecName: "kube-api-access-zm8s9") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "kube-api-access-zm8s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:37:11.200026 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.200000    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "17abc545-2d0b-4693-9e33-e77a5b9e2965" (UID: "17abc545-2d0b-4693-9e33-e77a5b9e2965"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:37:11.256429 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.256397    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgwbq\""
Jul 31 21:37:11.264417 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.264383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-499cx"
Jul 31 21:37:11.299651 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299617    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm8s9\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-kube-api-access-zm8s9\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.299651 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299651    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17abc545-2d0b-4693-9e33-e77a5b9e2965-ca-trust-extracted\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.299651 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299664    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-installation-pull-secrets\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.299958 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299679    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17abc545-2d0b-4693-9e33-e77a5b9e2965-trusted-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.299958 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299693    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-bound-sa-token\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.299958 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.299705    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17abc545-2d0b-4693-9e33-e77a5b9e2965-image-registry-private-configuration\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:11.434329 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:11.434229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-499cx"]
Jul 31 21:37:12.065549 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.065399    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x" event={"ID":"864b0c52-921b-4e23-94af-f957667f5a65","Type":"ContainerStarted","Data":"c413c98986ca18e11fb256160d90b8b3f381fce4af248313b97f24b23583cd24"}
Jul 31 21:37:12.065549 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.065458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x" event={"ID":"864b0c52-921b-4e23-94af-f957667f5a65","Type":"ContainerStarted","Data":"dba04e45356a6448e9b67df24cbfc9dda5936a857d2cdc2f837a7719903f1cb0"}
Jul 31 21:37:12.065549 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.065521    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:12.067257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.067226    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556bb5b8c4-c27gh"
Jul 31 21:37:12.067389 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.067230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-499cx" event={"ID":"b408572c-5e22-409f-b46f-d1dea8aa98c1","Type":"ContainerStarted","Data":"bc50ee0dc1a4ab847d90e149d29bb54726bf0781a016e629c8fa3ee5cf16f906"}
Jul 31 21:37:12.084250 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.084166    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x" podStartSLOduration=2.084147231 podStartE2EDuration="2.084147231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:12.083588957 +0000 UTC m=+67.871922534" watchObservedRunningTime="2026-07-31 21:37:12.084147231 +0000 UTC m=+67.872480840"
Jul 31 21:37:12.108631 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.108598    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-556bb5b8c4-c27gh"]
Jul 31 21:37:12.112405 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.112362    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-556bb5b8c4-c27gh"]
Jul 31 21:37:12.207850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.207558    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17abc545-2d0b-4693-9e33-e77a5b9e2965-registry-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:37:12.757488 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:12.757457    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17abc545-2d0b-4693-9e33-e77a5b9e2965" path="/var/lib/kubelet/pods/17abc545-2d0b-4693-9e33-e77a5b9e2965/volumes"
Jul 31 21:37:13.014357 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.014320    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:13.072054 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.072019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:13.075056 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.075020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7nkh" event={"ID":"ac76f4d2-9c49-4600-8286-67ba9e938edc","Type":"ContainerStarted","Data":"0412b8bc878fc71c99725cec77a8225c7df224658b7431236d12bc519184adbd"}
Jul 31 21:37:13.075204 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.075078    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h7nkh" event={"ID":"ac76f4d2-9c49-4600-8286-67ba9e938edc","Type":"ContainerStarted","Data":"d9a0a4adb7388a4bea37b5f9aa6eb7dbb4eeebe2b4cd3bc9dfef9ba80948578d"}
Jul 31 21:37:13.091031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.090979    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h7nkh" podStartSLOduration=67.512718293 podStartE2EDuration="1m9.090958739s" totalImagesPullingTime="1.578240446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:13.090469486 +0000 UTC m=+68.878803064" watchObservedRunningTime="2026-07-31 21:37:13.090958739 +0000 UTC m=+68.879292314"
Jul 31 21:37:13.234118 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.234052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:13.299072 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.298991    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:13.357835 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.357742    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:13.423288 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.423250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:13.423472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.423307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:13.424110 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.424083    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1475c67-dcf8-4a7d-bc10-73508e1ea642-service-ca-bundle\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:13.426829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.426788    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1475c67-dcf8-4a7d-bc10-73508e1ea642-metrics-certs\") pod \"router-default-58c9c7d678-8j8t8\" (UID: \"d1475c67-dcf8-4a7d-bc10-73508e1ea642\") " pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:13.660475 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.660394    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-px54w\""
Jul 31 21:37:13.668443 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:13.668379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:14.757463 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:14.757433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:14.914535 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:14.914487    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:14.975474 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:14.975430    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:16.285424 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.285381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:16.389070 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.389029    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:16.453916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.453882    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"]
Jul 31 21:37:16.456603 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.456582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:16.458661 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.458637    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 31 21:37:16.458773 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.458649    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q7wh9\""
Jul 31 21:37:16.465713 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.465684    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"]
Jul 31 21:37:16.465964 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.465944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:16.547517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.547484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d9e74fa-ced1-42d7-a3e3-5b4250346fba-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xpfst\" (UID: \"5d9e74fa-ced1-42d7-a3e3-5b4250346fba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:16.626713 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.626680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:16.648093 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.648065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d9e74fa-ced1-42d7-a3e3-5b4250346fba-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xpfst\" (UID: \"5d9e74fa-ced1-42d7-a3e3-5b4250346fba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:16.650790 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.650758    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d9e74fa-ced1-42d7-a3e3-5b4250346fba-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xpfst\" (UID: \"5d9e74fa-ced1-42d7-a3e3-5b4250346fba\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:16.659675 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.659476    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58c9c7d678-8j8t8"]
Jul 31 21:37:16.667431 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:16.667375    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1475c67_dcf8_4a7d_bc10_73508e1ea642.slice/crio-a558acdf9195e713af8c053a2f8fb639c9d6ee71b1f571140f89c57e32674dcb WatchSource:0}: Error finding container a558acdf9195e713af8c053a2f8fb639c9d6ee71b1f571140f89c57e32674dcb: Status 404 returned error can't find the container with id a558acdf9195e713af8c053a2f8fb639c9d6ee71b1f571140f89c57e32674dcb
Jul 31 21:37:16.766540 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.766507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:16.907502 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:16.907463    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"]
Jul 31 21:37:16.912490 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:16.912456    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9e74fa_ced1_42d7_a3e3_5b4250346fba.slice/crio-c128163e8476f7cd932db95bd1fe17b1520a4493e59a45be35c1686a2d88acd8 WatchSource:0}: Error finding container c128163e8476f7cd932db95bd1fe17b1520a4493e59a45be35c1686a2d88acd8: Status 404 returned error can't find the container with id c128163e8476f7cd932db95bd1fe17b1520a4493e59a45be35c1686a2d88acd8
Jul 31 21:37:17.090526 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.090411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58c9c7d678-8j8t8" event={"ID":"d1475c67-dcf8-4a7d-bc10-73508e1ea642","Type":"ContainerStarted","Data":"ae6fadc1b57027d06c2130373660eba9ae506cb724e5aea87bc7d6b7c7f3e746"}
Jul 31 21:37:17.090526 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.090482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58c9c7d678-8j8t8" event={"ID":"d1475c67-dcf8-4a7d-bc10-73508e1ea642","Type":"ContainerStarted","Data":"a558acdf9195e713af8c053a2f8fb639c9d6ee71b1f571140f89c57e32674dcb"}
Jul 31 21:37:17.091936 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.091911    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mxxvz" event={"ID":"b12acf64-69f3-4ed4-98dc-6081ba4b9218","Type":"ContainerStarted","Data":"8cecc612d0da7f92675c392906cd0e850918d416f8e54b3321dea0b18708b7a6"}
Jul 31 21:37:17.092085 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.091982    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:37:17.093315 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.093294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xm2fg" event={"ID":"0277b2e7-fe6e-427a-a3e5-99f8e813049b","Type":"ContainerStarted","Data":"4add89440ec4110c6866cdd6f8d233d518dff8714c928d23907ecd6195f80db4"}
Jul 31 21:37:17.095189 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.095168    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-499cx" event={"ID":"b408572c-5e22-409f-b46f-d1dea8aa98c1","Type":"ContainerStarted","Data":"f4a04ee2c7d80c5e01b76a594c46407c1264dac0370e69a6641d47c8d6e38192"}
Jul 31 21:37:17.095294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.095207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-499cx" event={"ID":"b408572c-5e22-409f-b46f-d1dea8aa98c1","Type":"ContainerStarted","Data":"042103de1366b3d3e944e778d1a29037b60b9ac5cbee84b86c51c2c74e2d26f7"}
Jul 31 21:37:17.095294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.095240    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-499cx"
Jul 31 21:37:17.096326 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.096308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst" event={"ID":"5d9e74fa-ced1-42d7-a3e3-5b4250346fba","Type":"ContainerStarted","Data":"c128163e8476f7cd932db95bd1fe17b1520a4493e59a45be35c1686a2d88acd8"}
Jul 31 21:37:17.109136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.109081    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58c9c7d678-8j8t8" podStartSLOduration=36.109065856 podStartE2EDuration="36.109065856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:17.108844206 +0000 UTC m=+72.897177783" watchObservedRunningTime="2026-07-31 21:37:17.109065856 +0000 UTC m=+72.897399430"
Jul 31 21:37:17.124790 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.124737    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-499cx" podStartSLOduration=33.066109457 podStartE2EDuration="38.124720371s" totalImagesPullingTime="5.058610914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:17.124665689 +0000 UTC m=+72.912999274" watchObservedRunningTime="2026-07-31 21:37:17.124720371 +0000 UTC m=+72.913053939"
Jul 31 21:37:17.141835 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.141774    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mxxvz" podStartSLOduration=67.588095626 podStartE2EDuration="1m13.14175815s" totalImagesPullingTime="5.553662524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:17.140753224 +0000 UTC m=+72.929086836" watchObservedRunningTime="2026-07-31 21:37:17.14175815 +0000 UTC m=+72.930091723"
Jul 31 21:37:17.156639 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.156588    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xm2fg" podStartSLOduration=66.578823407 podStartE2EDuration="1m12.156571733s" totalImagesPullingTime="5.577748326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:17.155543073 +0000 UTC m=+72.943876647" watchObservedRunningTime="2026-07-31 21:37:17.156571733 +0000 UTC m=+72.944905306"
Jul 31 21:37:17.669367 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.669315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:17.671946 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:17.671917    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:18.101018 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.100981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst" event={"ID":"5d9e74fa-ced1-42d7-a3e3-5b4250346fba","Type":"ContainerStarted","Data":"c4e9a1a740af192bcccd836055cccd0de23cc48a4638c79dc380307bf0e0f213"}
Jul 31 21:37:18.101591 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.101564    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:18.101737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.101609    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:18.102667 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.102640    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58c9c7d678-8j8t8"
Jul 31 21:37:18.106161 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.106139    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst"
Jul 31 21:37:18.115547 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.115499    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xpfst" podStartSLOduration=1.123086203 podStartE2EDuration="2.115484473s" totalImagesPullingTime="992.39827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:18.114733547 +0000 UTC m=+73.903067121" watchObservedRunningTime="2026-07-31 21:37:18.115484473 +0000 UTC m=+73.903818046"
Jul 31 21:37:18.484565 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.484481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:18.521554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.521522    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"]
Jul 31 21:37:18.524774 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.524758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.527447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.527421    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 21:37:18.527994 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.527969    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 21:37:18.528115 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.528055    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 21:37:18.528173 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.528143    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 21:37:18.528260 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.528242    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 21:37:18.528309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.528242    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-99hp4\""
Jul 31 21:37:18.535201 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.535168    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"]
Jul 31 21:37:18.561245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.561216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:18.667175 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.667137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.667175 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.667178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.667407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.667248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.667407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.667284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmj89\" (UniqueName: \"kubernetes.io/projected/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-kube-api-access-vmj89\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.714392 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.714343    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:18.768613 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.768573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.768613 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.768614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj89\" (UniqueName: \"kubernetes.io/projected/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-kube-api-access-vmj89\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.768863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.768673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.768863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.768696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.769451 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.769420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.771224 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.771203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.771280 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.771256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.775927 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.775903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmj89\" (UniqueName: \"kubernetes.io/projected/1e25aa26-1c3e-4c68-b0f1-b85df982ac5f-kube-api-access-vmj89\") pod \"prometheus-operator-758d7cb874-cz7mq\" (UID: \"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.815507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.815470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:18.834428 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.834393    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"
Jul 31 21:37:18.874874 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.874834    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:18.963645 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:18.963611    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-cz7mq"]
Jul 31 21:37:18.967245 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:18.967217    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e25aa26_1c3e_4c68_b0f1_b85df982ac5f.slice/crio-24a1eb7aa70a316fa278056a464aa429598d742248ecfb41b6ba0a262cb7488b WatchSource:0}: Error finding container 24a1eb7aa70a316fa278056a464aa429598d742248ecfb41b6ba0a262cb7488b: Status 404 returned error can't find the container with id 24a1eb7aa70a316fa278056a464aa429598d742248ecfb41b6ba0a262cb7488b
Jul 31 21:37:19.105918 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:19.105803    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq" event={"ID":"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f","Type":"ContainerStarted","Data":"24a1eb7aa70a316fa278056a464aa429598d742248ecfb41b6ba0a262cb7488b"}
Jul 31 21:37:20.420526 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:20.420400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:21.114963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:21.114921    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq" event={"ID":"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f","Type":"ContainerStarted","Data":"3dd084f6e6bee2636dc970814d4afd4440e154eaeba4dde56caca9038476e56e"}
Jul 31 21:37:21.115153 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:21.114990    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq" event={"ID":"1e25aa26-1c3e-4c68-b0f1-b85df982ac5f","Type":"ContainerStarted","Data":"63b57cd9980f9cd18ad8eadf0d2b25d7f3e2749a1ad742631af6ab0a5855edfa"}
Jul 31 21:37:21.132196 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:21.132146    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-cz7mq" podStartSLOduration=1.961084002 podStartE2EDuration="3.132130382s" totalImagesPullingTime="1.17104638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:21.131430574 +0000 UTC m=+76.919764150" watchObservedRunningTime="2026-07-31 21:37:21.132130382 +0000 UTC m=+76.920463954"
Jul 31 21:37:22.636038 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.635995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:22.756033 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.756001    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:22.862234 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.862201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:22.913757 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.913681    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k24mh"]
Jul 31 21:37:22.917508 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.917476    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:22.920179 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.920148    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 21:37:22.920338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.920239    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 21:37:22.920338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.920287    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"]
Jul 31 21:37:22.920683 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.920659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 21:37:22.920836 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.920723    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6wjct\""
Jul 31 21:37:22.923464 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.923441    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:22.925641 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.925619    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 31 21:37:22.925765 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.925703    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rxfs4\""
Jul 31 21:37:22.925765 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.925736    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 31 21:37:22.925765 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.925748    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 31 21:37:22.938792 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.938762    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"]
Jul 31 21:37:22.971135 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:22.971101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.044294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.044258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.104635 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-tls\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/838d3474-4afb-4505-8a51-9659acfeb9fe-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-root\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-accelerators-collector-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.104777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xlzb\" (UniqueName: \"kubernetes.io/projected/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-api-access-6xlzb\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-sys\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-metrics-client-ca\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.104988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4gtm\" (UniqueName: \"kubernetes.io/projected/a24c53a6-cad4-4f80-a837-74b6cf2eea39-kube-api-access-v4gtm\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.105010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-textfile\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.105035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.105027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.105252 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.105079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-wtmp\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.147858 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.147826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.206172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xlzb\" (UniqueName: \"kubernetes.io/projected/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-api-access-6xlzb\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.206172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-sys\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-metrics-client-ca\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4gtm\" (UniqueName: \"kubernetes.io/projected/a24c53a6-cad4-4f80-a837-74b6cf2eea39-kube-api-access-v4gtm\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-sys\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-textfile\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-wtmp\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206302    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-tls\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/838d3474-4afb-4505-8a51-9659acfeb9fe-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.206436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-wtmp\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-root\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24c53a6-cad4-4f80-a837-74b6cf2eea39-root\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-accelerators-collector-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-textfile\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207023 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.206918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/838d3474-4afb-4505-8a51-9659acfeb9fe-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.207363 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.207075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-metrics-client-ca\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207363 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.207171    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-accelerators-collector-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.207470 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.207409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.207551 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.207533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.209012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.208981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-tls\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.209133 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.209043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24c53a6-cad4-4f80-a837-74b6cf2eea39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.209316 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.209299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.209373 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.209358    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.217699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.217661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xlzb\" (UniqueName: \"kubernetes.io/projected/838d3474-4afb-4505-8a51-9659acfeb9fe-kube-api-access-6xlzb\") pod \"kube-state-metrics-6bd9664c4-2p4tv\" (UID: \"838d3474-4afb-4505-8a51-9659acfeb9fe\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.219475 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.219447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4gtm\" (UniqueName: \"kubernetes.io/projected/a24c53a6-cad4-4f80-a837-74b6cf2eea39-kube-api-access-v4gtm\") pod \"node-exporter-k24mh\" (UID: \"a24c53a6-cad4-4f80-a837-74b6cf2eea39\") " pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.230432 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.230392    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k24mh"
Jul 31 21:37:23.234613 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.234594    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"
Jul 31 21:37:23.244667 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.244640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.247728 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:23.247694    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24c53a6_cad4_4f80_a837_74b6cf2eea39.slice/crio-31021d41ea52c9e5bf9d3e8d7e93e01fdb943b3f2c3b203acf930dfca0dffb2e WatchSource:0}: Error finding container 31021d41ea52c9e5bf9d3e8d7e93e01fdb943b3f2c3b203acf930dfca0dffb2e: Status 404 returned error can't find the container with id 31021d41ea52c9e5bf9d3e8d7e93e01fdb943b3f2c3b203acf930dfca0dffb2e
Jul 31 21:37:23.346292 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.346249    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.383624 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.383583    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv"]
Jul 31 21:37:23.386623 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:23.386596    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838d3474_4afb_4505_8a51_9659acfeb9fe.slice/crio-044e13a4d1a8469b54361bf0ff6051d5d3da1ff3717c5d0acef559bb9a2222d0 WatchSource:0}: Error finding container 044e13a4d1a8469b54361bf0ff6051d5d3da1ff3717c5d0acef559bb9a2222d0: Status 404 returned error can't find the container with id 044e13a4d1a8469b54361bf0ff6051d5d3da1ff3717c5d0acef559bb9a2222d0
Jul 31 21:37:23.469523 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.469438    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.876831 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.876793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.964017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.963983    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:23.967702 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.967664    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:37:23.971910 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.971885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:23.974029 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.974005    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 21:37:23.974247 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.974089    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 21:37:23.974573 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.974398    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 21:37:23.975198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.974961    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 21:37:23.975198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.974991    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 21:37:23.976013 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.975750    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 21:37:23.976116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.976053    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 21:37:23.977416 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.976844    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 21:37:23.977416 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.977334    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lsmhn\""
Jul 31 21:37:23.980305 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.977727    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 21:37:23.988488 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:23.988466    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:37:24.115695 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.115878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.115878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115749    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.115878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115779    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.115878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115805    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.115878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.115979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.116023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.116045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.116063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.116148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.116094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqxc\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.127237 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.127153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k24mh" event={"ID":"a24c53a6-cad4-4f80-a837-74b6cf2eea39","Type":"ContainerStarted","Data":"31021d41ea52c9e5bf9d3e8d7e93e01fdb943b3f2c3b203acf930dfca0dffb2e"}
Jul 31 21:37:24.128801 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.128768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv" event={"ID":"838d3474-4afb-4505-8a51-9659acfeb9fe","Type":"ContainerStarted","Data":"044e13a4d1a8469b54361bf0ff6051d5d3da1ff3717c5d0acef559bb9a2222d0"}
Jul 31 21:37:24.216646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqxc\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.216841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.216983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.217007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.217568 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.217542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.218000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.217975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.218494 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.218256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.218661 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.218511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.221314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.221263    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.222220 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.222168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.222511 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.222482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.222594 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.222520    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.223148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.223105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.223376 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.223270    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.223490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.223436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.223773 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.223731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.226449 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.226400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.226806 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.226782    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqxc\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc\") pod \"alertmanager-main-0\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.277622 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.277584    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:24.292267 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.292234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:37:24.840702 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:24.840674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:37:24.899715 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:37:24.899675    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24c53a6_cad4_4f80_a837_74b6cf2eea39.slice/crio-conmon-71e13830b1f085a505f7734ec7cc4127bf6de8ccb551d3fb74c2ebcea61b193f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24c53a6_cad4_4f80_a837_74b6cf2eea39.slice/crio-71e13830b1f085a505f7734ec7cc4127bf6de8ccb551d3fb74c2ebcea61b193f.scope\": RecentStats: unable to find data in memory cache]"
Jul 31 21:37:25.008026 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.007993    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-858697878d-fg4sr"]
Jul 31 21:37:25.011920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.011899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.014324 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014277    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 31 21:37:25.014423 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014361    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4l8uismh94olh\""
Jul 31 21:37:25.014423 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014382    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 31 21:37:25.014534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014361    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 31 21:37:25.014534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014359    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 31 21:37:25.014534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014437    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w2hq7\""
Jul 31 21:37:25.014643 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.014589    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 31 21:37:25.026114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.026080    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-858697878d-fg4sr"]
Jul 31 21:37:25.126785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceb4fc1-0547-48b1-8890-975d48ac8cc8-metrics-client-ca\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-grpc-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126891    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7g7t\" (UniqueName: \"kubernetes.io/projected/fceb4fc1-0547-48b1-8890-975d48ac8cc8-kube-api-access-n7g7t\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126939    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.126963    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.127026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.127243 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.127076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.139318 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.139276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"892288c5d1f0b7d32b99be94592e66daabb9c5fe72db42b150c61599dccb1baa"}
Jul 31 21:37:25.141660 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.141630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv" event={"ID":"838d3474-4afb-4505-8a51-9659acfeb9fe","Type":"ContainerStarted","Data":"f09a5a70640b0a4c7bf00c4ce05d6a2fc09daf4025dfce7be29d8bfd31802d2c"}
Jul 31 21:37:25.141805 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.141688    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv" event={"ID":"838d3474-4afb-4505-8a51-9659acfeb9fe","Type":"ContainerStarted","Data":"fe5463a719f630210ecafb2fdfd66be549989c6313e47f957080a8f2b35f1ecf"}
Jul 31 21:37:25.141805 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.141708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv" event={"ID":"838d3474-4afb-4505-8a51-9659acfeb9fe","Type":"ContainerStarted","Data":"95cefbb2d1f83d9978197e8acd90fcf453b9a68c1e85a8cdaa270127c73fd78b"}
Jul 31 21:37:25.143458 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.143427    2568 generic.go:356] "Generic (PLEG): container finished" podID="a24c53a6-cad4-4f80-a837-74b6cf2eea39" containerID="71e13830b1f085a505f7734ec7cc4127bf6de8ccb551d3fb74c2ebcea61b193f" exitCode=0
Jul 31 21:37:25.143582 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.143456    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k24mh" event={"ID":"a24c53a6-cad4-4f80-a837-74b6cf2eea39","Type":"ContainerDied","Data":"71e13830b1f085a505f7734ec7cc4127bf6de8ccb551d3fb74c2ebcea61b193f"}
Jul 31 21:37:25.161415 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.161328    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-2p4tv" podStartSLOduration=1.860834602 podStartE2EDuration="3.161303449s" totalImagesPullingTime="1.300468847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:25.160025884 +0000 UTC m=+80.948359456" watchObservedRunningTime="2026-07-31 21:37:25.161303449 +0000 UTC m=+80.949637024"
Jul 31 21:37:25.227937 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.227904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceb4fc1-0547-48b1-8890-975d48ac8cc8-metrics-client-ca\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228022 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.227956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-grpc-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228022 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.227998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228128 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7g7t\" (UniqueName: \"kubernetes.io/projected/fceb4fc1-0547-48b1-8890-975d48ac8cc8-kube-api-access-n7g7t\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228128 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228083    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228128 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228260 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.228954 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.228750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fceb4fc1-0547-48b1-8890-975d48ac8cc8-metrics-client-ca\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.231961 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.231797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.231961 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.231859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.232343 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.232315    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.232588 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.232560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.233381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.233344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-thanos-querier-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.233588 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.233570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fceb4fc1-0547-48b1-8890-975d48ac8cc8-secret-grpc-tls\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.239180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.239033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7g7t\" (UniqueName: \"kubernetes.io/projected/fceb4fc1-0547-48b1-8890-975d48ac8cc8-kube-api-access-n7g7t\") pod \"thanos-querier-858697878d-fg4sr\" (UID: \"fceb4fc1-0547-48b1-8890-975d48ac8cc8\") " pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.321536 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.321487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:25.497079 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.497040    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-858697878d-fg4sr"]
Jul 31 21:37:25.501130 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:25.501096    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfceb4fc1_0547_48b1_8890_975d48ac8cc8.slice/crio-33705ce7aaa6e25a86f9d23505d74ced370c59013c1b8cb22fd585104add8ed6 WatchSource:0}: Error finding container 33705ce7aaa6e25a86f9d23505d74ced370c59013c1b8cb22fd585104add8ed6: Status 404 returned error can't find the container with id 33705ce7aaa6e25a86f9d23505d74ced370c59013c1b8cb22fd585104add8ed6
Jul 31 21:37:25.830785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.830759    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:25.934122 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:25.934084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:26.035407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.035370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:26.150883 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.150768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k24mh" event={"ID":"a24c53a6-cad4-4f80-a837-74b6cf2eea39","Type":"ContainerStarted","Data":"4451fef4e909e24865a3b80c2b56bc02a0cd03ae28df4e515a0d6fa4c3eaf789"}
Jul 31 21:37:26.151060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.150877    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k24mh" event={"ID":"a24c53a6-cad4-4f80-a837-74b6cf2eea39","Type":"ContainerStarted","Data":"ef5eb5ef77001f315a760c0ff07645a39619bc46b1fc1231b7b7988dd79c4b01"}
Jul 31 21:37:26.152498 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.152445    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"33705ce7aaa6e25a86f9d23505d74ced370c59013c1b8cb22fd585104add8ed6"}
Jul 31 21:37:26.154496 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.154461    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="f31dd13cdfaad48b125568c7a52e437f410dbad46af362074d9d6e5a91387140" exitCode=0
Jul 31 21:37:26.154618 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.154540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"f31dd13cdfaad48b125568c7a52e437f410dbad46af362074d9d6e5a91387140"}
Jul 31 21:37:26.176138 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.176085    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k24mh" podStartSLOduration=2.657248422 podStartE2EDuration="4.176066835s" totalImagesPullingTime="1.436497966s" totalInitContainerRuntime="82.320447ms" isStatefulPod=true podCreationTimestamp="2026-07-31 21:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:26.174206084 +0000 UTC m=+81.962539681" watchObservedRunningTime="2026-07-31 21:37:26.176066835 +0000 UTC m=+81.964400407"
Jul 31 21:37:26.289437 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.289405    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:26.985012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:26.984971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:27.056929 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:27.056872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:27.105094 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:27.104298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-499cx"
Jul 31 21:37:27.649590 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:27.649558    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:27.943880 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:27.943309    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:28.168002 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.167961    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"6358a6f026dbf35507a0fbd737f61c86768616a0a4dc709942eb7f5fe3608111"}
Jul 31 21:37:28.168388 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.168089    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"5814b65477fc6f53a634d96dd50751a4c5e8cf9777906d14da07304953b60254"}
Jul 31 21:37:28.168388 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.168136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"0583c34f2249231db3a47bfb38c2d60da2e27ad036104316e009e44da28c2095"}
Jul 31 21:37:28.172525 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.172493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"5ce86210ebbdc3b639f92edc751a5f593011238a277e776602126eca6feaa2f3"}
Jul 31 21:37:28.172665 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.172566    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"3767f8e2d423389df911c8de8bdf095b3fb67542f25963b02ef2e600e41ff942"}
Jul 31 21:37:28.172665 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.172595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"97ee64e4173975fd672d8203fc5bd77cfafd8d9f17fc7aa4e78851569dfbd450"}
Jul 31 21:37:28.172665 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.172619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"180c2d7b6b63d6b13711ba57f56383ee48cc7a2273b7910db9e00d72be30441e"}
Jul 31 21:37:28.805408 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.805377    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:28.905198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:28.905153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:29.181457 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.181413    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"6e492ba53a02ebb321b5519858df44a1712acf8b386b7ce9bc78077a594fb49d"}
Jul 31 21:37:29.181956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.181503    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"e74f1c071daa5f3df104376edbcabfc4dac42fb97bba4776109e2c385ca2df32"}
Jul 31 21:37:29.181956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.181544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" event={"ID":"fceb4fc1-0547-48b1-8890-975d48ac8cc8","Type":"ContainerStarted","Data":"4dbfbe5e32125031cbde24a9094954132a9bed61e335da2cf305a4ba7133ab0c"}
Jul 31 21:37:29.181956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.181585    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:29.185563 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.185521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"c25b4c6a6c9a7c9723d06533ec7b7e88018e61ff1a3f874c0f9dd843914c4777"}
Jul 31 21:37:29.185678 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.185594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerStarted","Data":"4c1499481a8a64930aa99ca31f0fc197bd4ef826740105de1d5634bf8891261b"}
Jul 31 21:37:29.208599 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.208561    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:29.222486 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.221908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr" podStartSLOduration=2.122942662 podStartE2EDuration="5.221886621s" totalImagesPullingTime="3.098943959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:29.220154692 +0000 UTC m=+85.008488265" watchObservedRunningTime="2026-07-31 21:37:29.221886621 +0000 UTC m=+85.010220196"
Jul 31 21:37:29.249932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:29.249846    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.945292567 podStartE2EDuration="6.249807283s" totalImagesPullingTime="3.284910372s" totalInitContainerRuntime="19.604344ms" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:29.249100207 +0000 UTC m=+85.037433771" watchObservedRunningTime="2026-07-31 21:37:29.249807283 +0000 UTC m=+85.038140857"
Jul 31 21:37:30.538345 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:30.538308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:30.638340 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:30.638303    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:31.698742 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:31.698707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:31.792928 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:31.792891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:33.079764 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:33.079735    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bc8d6c5c5-5jw8x"
Jul 31 21:37:33.215941 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:33.215910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:33.272257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:33.272236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:35.198209 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:35.198177    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-858697878d-fg4sr"
Jul 31 21:37:35.973241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:35.973201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:36.075114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:36.075076    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:40.968498 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:40.968461    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:41.068725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:41.068692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:41.128972 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:41.128944    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:44.772017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.771987    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-rwb5n"]
Jul 31 21:37:44.777943 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.777924    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:37:44.779963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.779940    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 21:37:44.780083 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.779998    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-76glg\""
Jul 31 21:37:44.780083 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.780058    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 21:37:44.783646 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.783623    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-rwb5n"]
Jul 31 21:37:44.787017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.786995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:44.854013 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.853988    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:44.904982 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.904940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxb2\" (UniqueName: \"kubernetes.io/projected/2d0238b0-cf1f-47a8-bc74-98f05d9ab01e-kube-api-access-bgxb2\") pod \"downloads-77c974ffcf-rwb5n\" (UID: \"2d0238b0-cf1f-47a8-bc74-98f05d9ab01e\") " pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:37:44.911805 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:44.911766    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:45.006372 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.006337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxb2\" (UniqueName: \"kubernetes.io/projected/2d0238b0-cf1f-47a8-bc74-98f05d9ab01e-kube-api-access-bgxb2\") pod \"downloads-77c974ffcf-rwb5n\" (UID: \"2d0238b0-cf1f-47a8-bc74-98f05d9ab01e\") " pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:37:45.012555 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.012521    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:45.014780 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.014755    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxb2\" (UniqueName: \"kubernetes.io/projected/2d0238b0-cf1f-47a8-bc74-98f05d9ab01e-kube-api-access-bgxb2\") pod \"downloads-77c974ffcf-rwb5n\" (UID: \"2d0238b0-cf1f-47a8-bc74-98f05d9ab01e\") " pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:37:45.088734 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.088629    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:37:45.113276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.113238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:45.242758 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.242724    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-rwb5n"]
Jul 31 21:37:45.246298 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:45.246256    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0238b0_cf1f_47a8_bc74_98f05d9ab01e.slice/crio-d6593f8bf642c8881135420587ddc05a88592cee3e9f33f53f3143d7e4795685 WatchSource:0}: Error finding container d6593f8bf642c8881135420587ddc05a88592cee3e9f33f53f3143d7e4795685: Status 404 returned error can't find the container with id d6593f8bf642c8881135420587ddc05a88592cee3e9f33f53f3143d7e4795685
Jul 31 21:37:45.258862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.258829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-rwb5n" event={"ID":"2d0238b0-cf1f-47a8-bc74-98f05d9ab01e","Type":"ContainerStarted","Data":"d6593f8bf642c8881135420587ddc05a88592cee3e9f33f53f3143d7e4795685"}
Jul 31 21:37:45.452437 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.452349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:45.858573 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.858529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:45.915926 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:45.915884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:46.459607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:46.459545    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:46.560241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:46.560197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:46.660956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:46.660923    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:46.820295 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:46.820256    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:48.105144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.105085    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mxxvz"
Jul 31 21:37:48.121512 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.121477    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:48.222279 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.222239    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:48.323339 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.323293    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:48.760343 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.760307    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:48.861228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:48.861171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:51.468889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.468852    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:37:51.502882 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.502842    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:37:51.503076 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.502917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.506174 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.506146    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 21:37:51.506348 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.506230    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 21:37:51.506621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.506594    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-29lqv\""
Jul 31 21:37:51.506722 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.506620    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 21:37:51.506722 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.506620    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 21:37:51.507031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.507012    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 21:37:51.568320 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.568518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.568518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.568518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.568683 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbj4\" (UniqueName: \"kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.568683 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.568641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669498 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669460    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669669 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669669 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669548    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669669 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669809 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dbj4\" (UniqueName: \"kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.669809 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.669726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.670408 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.670380    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.670535 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.670421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.670535 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.670421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.672458 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.672414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.672796 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.672780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.678306 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.678282    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dbj4\" (UniqueName: \"kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4\") pod \"console-66f6447467-nznmw\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") " pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:51.816232 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:51.816176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:37:52.008424 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:52.008302    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:37:52.011667 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:37:52.011628    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80dc1fc4_d475_46c8_93b1_be7e4198fa9f.slice/crio-1b7194364b62289ddcedd4d1dc40593d048660d83f37c1dbf14338327d88c581 WatchSource:0}: Error finding container 1b7194364b62289ddcedd4d1dc40593d048660d83f37c1dbf14338327d88c581: Status 404 returned error can't find the container with id 1b7194364b62289ddcedd4d1dc40593d048660d83f37c1dbf14338327d88c581
Jul 31 21:37:52.292790 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:52.292750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6447467-nznmw" event={"ID":"80dc1fc4-d475-46c8-93b1-be7e4198fa9f","Type":"ContainerStarted","Data":"1b7194364b62289ddcedd4d1dc40593d048660d83f37c1dbf14338327d88c581"}
Jul 31 21:37:54.689222 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:54.689187    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:54.763714 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:54.763678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:57.097750 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:57.097716    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:37:57.200511 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:37:57.200476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:00.880198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:00.880164    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:01.473693 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.473654    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:38:01.477515 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.477478    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.484246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.484011    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 21:38:01.486922 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.486047    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:38:01.668550 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668717 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668719    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdm9q\" (UniqueName: \"kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.668940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.668876    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770283 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdm9q\" (UniqueName: \"kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.770750 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.770496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.771227 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.771198    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.771547 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.771521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.771951 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.771930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.772154 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.772130    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.773288 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.773267    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.773423 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.773402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.778476 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.778456    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdm9q\" (UniqueName: \"kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q\") pod \"console-5cfbcbc6fb-nnb8v\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") " pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:01.789619 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:01.789582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:02.172312 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.172283    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:38:02.175289 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:38:02.175243    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3681cf_60a1_4089_965c_61abf9fb0a36.slice/crio-7055b84dc652341b2b82ec82b9403cd9d272ba28bc052d9eae00dd06b682f26e WatchSource:0}: Error finding container 7055b84dc652341b2b82ec82b9403cd9d272ba28bc052d9eae00dd06b682f26e: Status 404 returned error can't find the container with id 7055b84dc652341b2b82ec82b9403cd9d272ba28bc052d9eae00dd06b682f26e
Jul 31 21:38:02.348160 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.348087    2568 generic.go:356] "Generic (PLEG): container finished" podID="5df90cb2-d6c8-47c1-8a45-a12b74bfe74d" containerID="0a51782387fa4895a037868148f89e633c765cbcb6ea6995773bea9d896801c8" exitCode=0
Jul 31 21:38:02.348292 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.348165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7" event={"ID":"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d","Type":"ContainerDied","Data":"0a51782387fa4895a037868148f89e633c765cbcb6ea6995773bea9d896801c8"}
Jul 31 21:38:02.348522 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.348508    2568 scope.go:117] "RemoveContainer" containerID="0a51782387fa4895a037868148f89e633c765cbcb6ea6995773bea9d896801c8"
Jul 31 21:38:02.350417 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.350265    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfbcbc6fb-nnb8v" event={"ID":"dc3681cf-60a1-4089-965c-61abf9fb0a36","Type":"ContainerStarted","Data":"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"}
Jul 31 21:38:02.350417 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.350308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfbcbc6fb-nnb8v" event={"ID":"dc3681cf-60a1-4089-965c-61abf9fb0a36","Type":"ContainerStarted","Data":"7055b84dc652341b2b82ec82b9403cd9d272ba28bc052d9eae00dd06b682f26e"}
Jul 31 21:38:02.352485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.352462    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-rwb5n" event={"ID":"2d0238b0-cf1f-47a8-bc74-98f05d9ab01e","Type":"ContainerStarted","Data":"cdd8f26bbeb02fa7cbf473a5e740e8f318e7d3c41c9f56699d67df3816292c37"}
Jul 31 21:38:02.352674 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.352646    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:38:02.354960 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.354936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6447467-nznmw" event={"ID":"80dc1fc4-d475-46c8-93b1-be7e4198fa9f","Type":"ContainerStarted","Data":"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"}
Jul 31 21:38:02.363999 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.363966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-rwb5n"
Jul 31 21:38:02.386272 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.385992    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f6447467-nznmw" podStartSLOduration=1.3732445549999999 podStartE2EDuration="11.38596938s" totalImagesPullingTime="10.012724825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:02.384334416 +0000 UTC m=+118.172667970" watchObservedRunningTime="2026-07-31 21:38:02.38596938 +0000 UTC m=+118.174302954"
Jul 31 21:38:02.402107 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.402033    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cfbcbc6fb-nnb8v" podStartSLOduration=1.402008087 podStartE2EDuration="1.402008087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:02.400451586 +0000 UTC m=+118.188785159" watchObservedRunningTime="2026-07-31 21:38:02.402008087 +0000 UTC m=+118.190341660"
Jul 31 21:38:02.417148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:02.416999    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-rwb5n" podStartSLOduration=1.582660133 podStartE2EDuration="18.416977896s" totalImagesPullingTime="16.834317763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:02.415799115 +0000 UTC m=+118.204132688" watchObservedRunningTime="2026-07-31 21:38:02.416977896 +0000 UTC m=+118.205311471"
Jul 31 21:38:03.362409 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:03.362363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-rs4l7" event={"ID":"5df90cb2-d6c8-47c1-8a45-a12b74bfe74d","Type":"ContainerStarted","Data":"830adf3e25814fd06ad16da9589c37a173299fa8bce992de1948f5caad7e27a1"}
Jul 31 21:38:03.762564 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:03.762516    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:03.830024 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:03.829982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:05.288551 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:05.288507    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:10.490679 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:10.490644    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:10.590770 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:10.590735    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:11.790579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.790539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:11.791046 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.790614    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:11.795572 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.795541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:11.819868 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.817840    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:11.819868 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.818840    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:11.824066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:11.824043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:12.407372 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:12.407340    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:12.407804 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:12.407789    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:38:12.465890 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:12.465844    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:38:14.896120 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:14.896086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:14.997538 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:14.997505    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:16.087943 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:16.087910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:16.189810 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:16.189769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:16.501362 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:16.501322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:16.601040 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:16.601003    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:17.425595 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:17.425554    2568 generic.go:356] "Generic (PLEG): container finished" podID="d539e0ff-ebd8-458e-9c80-4f2ab502ae14" containerID="46b42f52b29114d4b11becf9565545ec928abffc5122d76104a51763f2f41e1a" exitCode=0
Jul 31 21:38:17.425992 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:17.425629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gqxf9" event={"ID":"d539e0ff-ebd8-458e-9c80-4f2ab502ae14","Type":"ContainerDied","Data":"46b42f52b29114d4b11becf9565545ec928abffc5122d76104a51763f2f41e1a"}
Jul 31 21:38:17.426034 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:17.426024    2568 scope.go:117] "RemoveContainer" containerID="46b42f52b29114d4b11becf9565545ec928abffc5122d76104a51763f2f41e1a"
Jul 31 21:38:18.431940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:18.431904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gqxf9" event={"ID":"d539e0ff-ebd8-458e-9c80-4f2ab502ae14","Type":"ContainerStarted","Data":"2b4a30d78f47eb087819a354437e371700168ef6729e0b0b781c2639ccf242d2"}
Jul 31 21:38:21.583935 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:21.583896    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:21.641033 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:21.641000    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:33.761950 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:33.761914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:33.862114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:33.862082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:39.429602 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.429535    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66f6447467-nznmw" podUID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" containerName="console" containerID="cri-o://f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8" gracePeriod=15
Jul 31 21:38:39.711435 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.711410    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:39.815198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815354 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815225    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815354 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815270    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815354 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815307    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815505 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815363    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815505 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dbj4\" (UniqueName: \"kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4\") pod \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\" (UID: \"80dc1fc4-d475-46c8-93b1-be7e4198fa9f\") "
Jul 31 21:38:39.815666 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815631    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca" (OuterVolumeSpecName: "service-ca") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:38:39.815835 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815716    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config" (OuterVolumeSpecName: "console-config") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:38:39.815835 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.815749    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:38:39.817607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.817577    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4" (OuterVolumeSpecName: "kube-api-access-5dbj4") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "kube-api-access-5dbj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:38:39.817694 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.817610    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:39.817694 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.817629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80dc1fc4-d475-46c8-93b1-be7e4198fa9f" (UID: "80dc1fc4-d475-46c8-93b1-be7e4198fa9f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:39.916755 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916726    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-oauth-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:39.916755 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916752    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dbj4\" (UniqueName: \"kubernetes.io/projected/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-kube-api-access-5dbj4\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:39.916932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916767    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:39.916932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916779    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:39.916932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916790    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:39.916932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:39.916801    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80dc1fc4-d475-46c8-93b1-be7e4198fa9f-console-oauth-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:40.533116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.533080    2568 generic.go:356] "Generic (PLEG): container finished" podID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" containerID="f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8" exitCode=0
Jul 31 21:38:40.533501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.533139    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f6447467-nznmw"
Jul 31 21:38:40.533501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.533139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6447467-nznmw" event={"ID":"80dc1fc4-d475-46c8-93b1-be7e4198fa9f","Type":"ContainerDied","Data":"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"}
Jul 31 21:38:40.533501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.533279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f6447467-nznmw" event={"ID":"80dc1fc4-d475-46c8-93b1-be7e4198fa9f","Type":"ContainerDied","Data":"1b7194364b62289ddcedd4d1dc40593d048660d83f37c1dbf14338327d88c581"}
Jul 31 21:38:40.533501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.533320    2568 scope.go:117] "RemoveContainer" containerID="f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"
Jul 31 21:38:40.542228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.542206    2568 scope.go:117] "RemoveContainer" containerID="f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"
Jul 31 21:38:40.542512 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:38:40.542488    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8\": container with ID starting with f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8 not found: ID does not exist" containerID="f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"
Jul 31 21:38:40.542587 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.542519    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8"} err="failed to get container status \"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8\": rpc error: code = NotFound desc = could not find container \"f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8\": container with ID starting with f5c711195afb6a425c5669171de16b580e6412b46a644717e1bacb46e48a95f8 not found: ID does not exist"
Jul 31 21:38:40.555086 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.555055    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:38:40.560862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.560838    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f6447467-nznmw"]
Jul 31 21:38:40.755916 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:40.755885    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" path="/var/lib/kubelet/pods/80dc1fc4-d475-46c8-93b1-be7e4198fa9f/volumes"
Jul 31 21:38:42.155063 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:42.155026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:42.265461 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:42.265429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:43.217981 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.217943    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:43.218396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218241    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="alertmanager" containerID="cri-o://180c2d7b6b63d6b13711ba57f56383ee48cc7a2273b7910db9e00d72be30441e" gracePeriod=120
Jul 31 21:38:43.218396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218311    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-metric" containerID="cri-o://4c1499481a8a64930aa99ca31f0fc197bd4ef826740105de1d5634bf8891261b" gracePeriod=120
Jul 31 21:38:43.218396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218333    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="prom-label-proxy" containerID="cri-o://c25b4c6a6c9a7c9723d06533ec7b7e88018e61ff1a3f874c0f9dd843914c4777" gracePeriod=120
Jul 31 21:38:43.218396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218357    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-web" containerID="cri-o://3767f8e2d423389df911c8de8bdf095b3fb67542f25963b02ef2e600e41ff942" gracePeriod=120
Jul 31 21:38:43.218628 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218378    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="config-reloader" containerID="cri-o://97ee64e4173975fd672d8203fc5bd77cfafd8d9f17fc7aa4e78851569dfbd450" gracePeriod=120
Jul 31 21:38:43.218628 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.218495    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy" containerID="cri-o://5ce86210ebbdc3b639f92edc751a5f593011238a277e776602126eca6feaa2f3" gracePeriod=120
Jul 31 21:38:43.550374 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550342    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="c25b4c6a6c9a7c9723d06533ec7b7e88018e61ff1a3f874c0f9dd843914c4777" exitCode=0
Jul 31 21:38:43.550374 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550366    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="5ce86210ebbdc3b639f92edc751a5f593011238a277e776602126eca6feaa2f3" exitCode=0
Jul 31 21:38:43.550374 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550372    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="97ee64e4173975fd672d8203fc5bd77cfafd8d9f17fc7aa4e78851569dfbd450" exitCode=0
Jul 31 21:38:43.550374 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550378    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="180c2d7b6b63d6b13711ba57f56383ee48cc7a2273b7910db9e00d72be30441e" exitCode=0
Jul 31 21:38:43.550610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"c25b4c6a6c9a7c9723d06533ec7b7e88018e61ff1a3f874c0f9dd843914c4777"}
Jul 31 21:38:43.550610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"5ce86210ebbdc3b639f92edc751a5f593011238a277e776602126eca6feaa2f3"}
Jul 31 21:38:43.550610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550510    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"97ee64e4173975fd672d8203fc5bd77cfafd8d9f17fc7aa4e78851569dfbd450"}
Jul 31 21:38:43.550610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:43.550533    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"180c2d7b6b63d6b13711ba57f56383ee48cc7a2273b7910db9e00d72be30441e"}
Jul 31 21:38:44.563223 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:44.563132    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="4c1499481a8a64930aa99ca31f0fc197bd4ef826740105de1d5634bf8891261b" exitCode=0
Jul 31 21:38:44.563223 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:44.563164    2568 generic.go:356] "Generic (PLEG): container finished" podID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerID="3767f8e2d423389df911c8de8bdf095b3fb67542f25963b02ef2e600e41ff942" exitCode=0
Jul 31 21:38:44.563223 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:44.563200    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"4c1499481a8a64930aa99ca31f0fc197bd4ef826740105de1d5634bf8891261b"}
Jul 31 21:38:44.563620 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:44.563281    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"3767f8e2d423389df911c8de8bdf095b3fb67542f25963b02ef2e600e41ff942"}
Jul 31 21:38:44.987955 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:44.987927    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.060021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.059985    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060209 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060071    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060209 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060109    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060209 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060161    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060217    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060255    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060292    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060324    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcqxc\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060352    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060380    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060406    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060433    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060459    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:38:45.060657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060477    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume\") pod \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\" (UID: \"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a\") "
Jul 31 21:38:45.060945 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060809    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.060945 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.060913    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:38:45.061292 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.061264    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:38:45.063001 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.062971    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.063116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.063039    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume" (OuterVolumeSpecName: "config-volume") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.063841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.063770    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out" (OuterVolumeSpecName: "config-out") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:38:45.064067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.064016    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.064067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.064024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:38:45.064318 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.064278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.065390 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.065354    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc" (OuterVolumeSpecName: "kube-api-access-dcqxc") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "kube-api-access-dcqxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:38:45.065860 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.065802    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.070575 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.070547    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.077579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.077550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config" (OuterVolumeSpecName: "web-config") pod "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" (UID: "3d0bf3f7-8cda-453d-9b03-2cc37d38f36a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.161962    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-main-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.161991    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-metrics-client-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162003    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162015    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162025    2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-cluster-tls-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162033    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-alertmanager-main-db\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162041 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162042    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcqxc\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-kube-api-access-dcqxc\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162051    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162062    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-tls-assets\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162072    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-out\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162080    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-web-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.162379 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.162087    2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:38:45.571112 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.571084    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.571112 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.571091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3d0bf3f7-8cda-453d-9b03-2cc37d38f36a","Type":"ContainerDied","Data":"892288c5d1f0b7d32b99be94592e66daabb9c5fe72db42b150c61599dccb1baa"}
Jul 31 21:38:45.571519 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.571176    2568 scope.go:117] "RemoveContainer" containerID="c25b4c6a6c9a7c9723d06533ec7b7e88018e61ff1a3f874c0f9dd843914c4777"
Jul 31 21:38:45.579277 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.579255    2568 scope.go:117] "RemoveContainer" containerID="4c1499481a8a64930aa99ca31f0fc197bd4ef826740105de1d5634bf8891261b"
Jul 31 21:38:45.597473 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.597438    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:45.598741 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.598682    2568 scope.go:117] "RemoveContainer" containerID="5ce86210ebbdc3b639f92edc751a5f593011238a277e776602126eca6feaa2f3"
Jul 31 21:38:45.600553 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.600527    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:45.606317 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.606281    2568 scope.go:117] "RemoveContainer" containerID="3767f8e2d423389df911c8de8bdf095b3fb67542f25963b02ef2e600e41ff942"
Jul 31 21:38:45.613563 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.613539    2568 scope.go:117] "RemoveContainer" containerID="97ee64e4173975fd672d8203fc5bd77cfafd8d9f17fc7aa4e78851569dfbd450"
Jul 31 21:38:45.620877 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.620855    2568 scope.go:117] "RemoveContainer" containerID="180c2d7b6b63d6b13711ba57f56383ee48cc7a2273b7910db9e00d72be30441e"
Jul 31 21:38:45.629219 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629199    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:45.629304 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629248    2568 scope.go:117] "RemoveContainer" containerID="f31dd13cdfaad48b125568c7a52e437f410dbad46af362074d9d6e5a91387140"
Jul 31 21:38:45.629567 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629552    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629571    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629582    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="alertmanager"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629588    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="alertmanager"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629594    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-web"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629600    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-web"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629610    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="prom-label-proxy"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629616    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="prom-label-proxy"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629623    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" containerName="console"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629628    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" containerName="console"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629639    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="init-config-reloader"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629644    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="init-config-reloader"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629653    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="config-reloader"
Jul 31 21:38:45.629652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629658    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="config-reloader"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629669    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-metric"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629676    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-metric"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629740    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="80dc1fc4-d475-46c8-93b1-be7e4198fa9f" containerName="console"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629755    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629766    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="prom-label-proxy"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629775    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="alertmanager"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629784    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-metric"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629793    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="kube-rbac-proxy-web"
Jul 31 21:38:45.630184 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.629801    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" containerName="config-reloader"
Jul 31 21:38:45.660722 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.660694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:45.660860 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.660837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.663046 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663023    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 21:38:45.663203 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663026    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 21:38:45.663305 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663026    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 21:38:45.663305 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663047    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lsmhn\""
Jul 31 21:38:45.663422 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663087    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 21:38:45.663655 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 21:38:45.663736 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663691    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 21:38:45.663736 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663700    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 21:38:45.663998 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.663982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 21:38:45.668640 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.668623    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 21:38:45.767064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767088    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-out\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4nj5\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-kube-api-access-v4nj5\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-web-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-volume\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.767493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.767389    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868325 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868325 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4nj5\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-kube-api-access-v4nj5\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868325 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868319    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-web-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868629 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-volume\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868684 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868735 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868788 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868858 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868858 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868959 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-out\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.868959 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.868926    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.869217 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.869190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.869336 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.869311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.871505 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.871652 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-volume\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.871734 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-web-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.871877 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871851    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.871990 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.872039 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.871989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.872084 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.872032    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.872155 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.872136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785e0a25-c430-45d2-b4ac-f9568ac20dcc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.872605 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.872583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/785e0a25-c430-45d2-b4ac-f9568ac20dcc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.873534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.873518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/785e0a25-c430-45d2-b4ac-f9568ac20dcc-config-out\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.876163 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.876141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4nj5\" (UniqueName: \"kubernetes.io/projected/785e0a25-c430-45d2-b4ac-f9568ac20dcc-kube-api-access-v4nj5\") pod \"alertmanager-main-0\" (UID: \"785e0a25-c430-45d2-b4ac-f9568ac20dcc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:45.970593 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:45.970555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 21:38:46.158504 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:46.158407    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 21:38:46.162595 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:38:46.162559    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785e0a25_c430_45d2_b4ac_f9568ac20dcc.slice/crio-955fc9a613d7f334fb52a6ada212b4d11bf0b69cb93f4c67f55ce6281962bc90 WatchSource:0}: Error finding container 955fc9a613d7f334fb52a6ada212b4d11bf0b69cb93f4c67f55ce6281962bc90: Status 404 returned error can't find the container with id 955fc9a613d7f334fb52a6ada212b4d11bf0b69cb93f4c67f55ce6281962bc90
Jul 31 21:38:46.577505 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:46.577471    2568 generic.go:356] "Generic (PLEG): container finished" podID="785e0a25-c430-45d2-b4ac-f9568ac20dcc" containerID="d0647c7d4e642b34f12af8bfc54fd4ade3ee16ab7407f9d485f42a49190024d5" exitCode=0
Jul 31 21:38:46.577833 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:46.577515    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerDied","Data":"d0647c7d4e642b34f12af8bfc54fd4ade3ee16ab7407f9d485f42a49190024d5"}
Jul 31 21:38:46.577833 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:46.577581    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"955fc9a613d7f334fb52a6ada212b4d11bf0b69cb93f4c67f55ce6281962bc90"}
Jul 31 21:38:46.756220 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:46.756191    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d0bf3f7-8cda-453d-9b03-2cc37d38f36a" path="/var/lib/kubelet/pods/3d0bf3f7-8cda-453d-9b03-2cc37d38f36a/volumes"
Jul 31 21:38:47.272720 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.272683    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74797748c-g578j"]
Jul 31 21:38:47.276304 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.276275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.278967 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.278935    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 31 21:38:47.279119 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.279063    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 31 21:38:47.279119 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.279086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wvqpk\""
Jul 31 21:38:47.279239 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.279182    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 31 21:38:47.279291 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.279259    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 31 21:38:47.279910 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.279891    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 31 21:38:47.284807 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.284785    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 31 21:38:47.293097 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.293077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74797748c-g578j"]
Jul 31 21:38:47.382867 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.382833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.382878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-serving-certs-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.382903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdh62\" (UniqueName: \"kubernetes.io/projected/073ba452-b682-47da-be77-2f6adb8b7ad3-kube-api-access-hdh62\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.382929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.383012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-federate-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.383050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-metrics-client-ca\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.383076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.383172 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.383112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483578 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-serving-certs-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483598    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdh62\" (UniqueName: \"kubernetes.io/projected/073ba452-b682-47da-be77-2f6adb8b7ad3-kube-api-access-hdh62\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-federate-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-metrics-client-ca\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.483785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.484055 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.484055 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.483869    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.485942 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.485428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-metrics-client-ca\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.485942 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.485615    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.485942 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.485897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073ba452-b682-47da-be77-2f6adb8b7ad3-serving-certs-ca-bundle\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.487543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.487511    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-federate-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.488076 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.488051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.488618 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.488589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-secret-telemeter-client\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.488745 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.488728    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/073ba452-b682-47da-be77-2f6adb8b7ad3-telemeter-client-tls\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.495137 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.495110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdh62\" (UniqueName: \"kubernetes.io/projected/073ba452-b682-47da-be77-2f6adb8b7ad3-kube-api-access-hdh62\") pod \"telemeter-client-74797748c-g578j\" (UID: \"073ba452-b682-47da-be77-2f6adb8b7ad3\") " pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.586699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"b4f99e5211e020fa843f83418a8cebf38dd0fe17e3b005b68401cea2c88bd5d7"}
Jul 31 21:38:47.586699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"b0dcc81b77c96a19f1b9f9c0a911ed186d1c856a2067676f6ee913de399e2d18"}
Jul 31 21:38:47.586699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"3509e98c593585d12ba2169a666e854ff89f3a0f570c99df08d7437fb478c4a8"}
Jul 31 21:38:47.586699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74797748c-g578j"
Jul 31 21:38:47.587345 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"aa89bccdabc7d10818a5e64e94eb9981d787db8bc4b2cce49e9c35992818a5a7"}
Jul 31 21:38:47.587345 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"4fdc9f51ade44f3ae22e419b6540891f36fb8556e93e8f5b0880a334bddc67fb"}
Jul 31 21:38:47.587345 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.586987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"785e0a25-c430-45d2-b4ac-f9568ac20dcc","Type":"ContainerStarted","Data":"eb1778ffc832650fbe5a42c1a10d6553392270c9ea7ff762e7ed367a114efbff"}
Jul 31 21:38:47.618067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.618008    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.602426199 podStartE2EDuration="2.617989527s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.563328ms" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:47.615999687 +0000 UTC m=+163.404333273" watchObservedRunningTime="2026-07-31 21:38:47.617989527 +0000 UTC m=+163.406323100"
Jul 31 21:38:47.754408 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:47.754383    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74797748c-g578j"]
Jul 31 21:38:47.756868 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:38:47.756834    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073ba452_b682_47da_be77_2f6adb8b7ad3.slice/crio-3d1168e97539e48a9e63a8e02693f258264f9ee63b2a4d3f28137d7f07e56867 WatchSource:0}: Error finding container 3d1168e97539e48a9e63a8e02693f258264f9ee63b2a4d3f28137d7f07e56867: Status 404 returned error can't find the container with id 3d1168e97539e48a9e63a8e02693f258264f9ee63b2a4d3f28137d7f07e56867
Jul 31 21:38:48.592771 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:48.592731    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74797748c-g578j" event={"ID":"073ba452-b682-47da-be77-2f6adb8b7ad3","Type":"ContainerStarted","Data":"3d1168e97539e48a9e63a8e02693f258264f9ee63b2a4d3f28137d7f07e56867"}
Jul 31 21:38:49.598879 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:49.598844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74797748c-g578j" event={"ID":"073ba452-b682-47da-be77-2f6adb8b7ad3","Type":"ContainerStarted","Data":"2dbb8bdb720565f2023a50ec9b79de07998c36f65e056bb60842fb7869d099a3"}
Jul 31 21:38:50.605030 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.604992    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74797748c-g578j" event={"ID":"073ba452-b682-47da-be77-2f6adb8b7ad3","Type":"ContainerStarted","Data":"4b776da508f2d8fb39b39e326075efad279d16d1f94b98ecc08ecaa4f50c66f8"}
Jul 31 21:38:50.605518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.605061    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74797748c-g578j" event={"ID":"073ba452-b682-47da-be77-2f6adb8b7ad3","Type":"ContainerStarted","Data":"307a28f6c3293036cda21aae63c5ef215964aff289f0e43b2aeedd484e422333"}
Jul 31 21:38:50.628042 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.627993    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74797748c-g578j" podStartSLOduration=1.901196047 podStartE2EDuration="3.627977453s" totalImagesPullingTime="1.726781406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:50.6267706 +0000 UTC m=+166.415104175" watchObservedRunningTime="2026-07-31 21:38:50.627977453 +0000 UTC m=+166.416311317"
Jul 31 21:38:50.730317 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.730288    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:38:50.733881 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.733863    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.758600 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.758575    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:38:50.794795 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.794760    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:38:50.916048 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.915951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916048 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916426 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916296    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:50.916426 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:50.916324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df8rz\" (UniqueName: \"kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017484 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017484 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df8rz\" (UniqueName: \"kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.017697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.017620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.018309 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.018279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.018477 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.018452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.018477 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.018343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.018670 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.018644    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.019973 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.019950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.020150 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.020131    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.026948 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.026927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df8rz\" (UniqueName: \"kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz\") pod \"console-d55c997f8-prfhm\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") " pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.044651 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.044634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:38:51.177925 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.177848    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:38:51.180729 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:38:51.180698    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bf1176_87ac_4ef4_9c5b_5a2e9c6d6365.slice/crio-beb2aa6f602694a60f59614971e8ba5b88d31cd46deb2b32b799ce031d42187a WatchSource:0}: Error finding container beb2aa6f602694a60f59614971e8ba5b88d31cd46deb2b32b799ce031d42187a: Status 404 returned error can't find the container with id beb2aa6f602694a60f59614971e8ba5b88d31cd46deb2b32b799ce031d42187a
Jul 31 21:38:51.613067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.613021    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d55c997f8-prfhm" event={"ID":"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365","Type":"ContainerStarted","Data":"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"}
Jul 31 21:38:51.613542 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.613090    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d55c997f8-prfhm" event={"ID":"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365","Type":"ContainerStarted","Data":"beb2aa6f602694a60f59614971e8ba5b88d31cd46deb2b32b799ce031d42187a"}
Jul 31 21:38:51.633392 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:51.633326    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d55c997f8-prfhm" podStartSLOduration=1.633301233 podStartE2EDuration="1.633301233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:51.633274328 +0000 UTC m=+167.421607939" watchObservedRunningTime="2026-07-31 21:38:51.633301233 +0000 UTC m=+167.421634808"
Jul 31 21:38:57.548872 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:38:57.548768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:01.045611 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.045564    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:39:01.046049 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.045708    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:39:01.050327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.050305    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:39:01.666609 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.666581    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:39:01.713287 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.713252    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:39:01.822697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.822665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:01.878051 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.878013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:01.938483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:01.938378    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:26.735116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:26.735068    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cfbcbc6fb-nnb8v" podUID="dc3681cf-60a1-4089-965c-61abf9fb0a36" containerName="console" containerID="cri-o://3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e" gracePeriod=15
Jul 31 21:39:26.972278 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:26.972255    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:39:27.101749 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.101726    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.101914 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.101763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.101914 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.101788    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.101914 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.101841    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.102087 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.101952    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.102087 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdm9q\" (UniqueName: \"kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.102190 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102118    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert\") pod \"dc3681cf-60a1-4089-965c-61abf9fb0a36\" (UID: \"dc3681cf-60a1-4089-965c-61abf9fb0a36\") "
Jul 31 21:39:27.102250 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102223    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config" (OuterVolumeSpecName: "console-config") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:39:27.102328 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102296    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:39:27.102387 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102305    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:39:27.102554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102534    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:39:27.102554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102545    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.102659 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102567    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.102659 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.102581    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-trusted-ca-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.103947 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.103926    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:39:27.104547 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.104525    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:39:27.104595 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.104529    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q" (OuterVolumeSpecName: "kube-api-access-rdm9q") pod "dc3681cf-60a1-4089-965c-61abf9fb0a36" (UID: "dc3681cf-60a1-4089-965c-61abf9fb0a36"). InnerVolumeSpecName "kube-api-access-rdm9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:39:27.203757 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.203732    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-oauth-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.203757 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.203755    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdm9q\" (UniqueName: \"kubernetes.io/projected/dc3681cf-60a1-4089-965c-61abf9fb0a36-kube-api-access-rdm9q\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.203902 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.203764    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc3681cf-60a1-4089-965c-61abf9fb0a36-oauth-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.203902 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.203774    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc3681cf-60a1-4089-965c-61abf9fb0a36-console-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:39:27.774928 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.774889    2568 generic.go:356] "Generic (PLEG): container finished" podID="dc3681cf-60a1-4089-965c-61abf9fb0a36" containerID="3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e" exitCode=0
Jul 31 21:39:27.775338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.774936    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfbcbc6fb-nnb8v"
Jul 31 21:39:27.775338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.774978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfbcbc6fb-nnb8v" event={"ID":"dc3681cf-60a1-4089-965c-61abf9fb0a36","Type":"ContainerDied","Data":"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"}
Jul 31 21:39:27.775338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.775032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfbcbc6fb-nnb8v" event={"ID":"dc3681cf-60a1-4089-965c-61abf9fb0a36","Type":"ContainerDied","Data":"7055b84dc652341b2b82ec82b9403cd9d272ba28bc052d9eae00dd06b682f26e"}
Jul 31 21:39:27.775338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.775054    2568 scope.go:117] "RemoveContainer" containerID="3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"
Jul 31 21:39:27.784639 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.784622    2568 scope.go:117] "RemoveContainer" containerID="3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"
Jul 31 21:39:27.784950 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:39:27.784928    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e\": container with ID starting with 3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e not found: ID does not exist" containerID="3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"
Jul 31 21:39:27.785018 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.784957    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e"} err="failed to get container status \"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e\": rpc error: code = NotFound desc = could not find container \"3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e\": container with ID starting with 3f8b1306cee63f157acb1726dfff7c35bc9631baa78ad3835167b53a085c4f7e not found: ID does not exist"
Jul 31 21:39:27.795358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.795333    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:39:27.798560 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:27.798534    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfbcbc6fb-nnb8v"]
Jul 31 21:39:28.757018 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:28.756983    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3681cf-60a1-4089-965c-61abf9fb0a36" path="/var/lib/kubelet/pods/dc3681cf-60a1-4089-965c-61abf9fb0a36/volumes"
Jul 31 21:39:35.081012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:35.080975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:48.244119 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:48.244051    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:57.400131 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:57.400091    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:39:57.500054 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:39:57.500021    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:09.302360 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:09.302321    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:09.401910 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:09.401883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:18.891196 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:18.891159    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:18.989895 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:18.989859    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:19.982908 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.982873    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:40:19.983347 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.983223    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3681cf-60a1-4089-965c-61abf9fb0a36" containerName="console"
Jul 31 21:40:19.983347 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.983234    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3681cf-60a1-4089-965c-61abf9fb0a36" containerName="console"
Jul 31 21:40:19.983347 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.983293    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3681cf-60a1-4089-965c-61abf9fb0a36" containerName="console"
Jul 31 21:40:19.990019 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.989992    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998369 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wngss\" (UniqueName: \"kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998473    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:19.998697 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:19.998534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.002895 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.002869    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:40:20.048362 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.048339    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:20.099180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099268 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099191    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099268 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099268 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wngss\" (UniqueName: \"kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.099396 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.100004 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.099977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.100115 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.100034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.100115 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.100034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.100235 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.100149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.101699 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.101677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.101859 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.101843    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.109586 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.109562    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wngss\" (UniqueName: \"kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss\") pod \"console-557c65f767-4cpf7\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") " pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.153861 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.153835    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:20.298910 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.298884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:20.437861 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.437837    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:40:20.440471 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:40:20.440433    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c0204b_e3e8_4c05_bd02_6b6c1d7d4e33.slice/crio-1ef294ae60b517a8b8b0535fc9f4044b05b5213894493834d0368f9440cdf247 WatchSource:0}: Error finding container 1ef294ae60b517a8b8b0535fc9f4044b05b5213894493834d0368f9440cdf247: Status 404 returned error can't find the container with id 1ef294ae60b517a8b8b0535fc9f4044b05b5213894493834d0368f9440cdf247
Jul 31 21:40:20.999704 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.999670    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c65f767-4cpf7" event={"ID":"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33","Type":"ContainerStarted","Data":"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"}
Jul 31 21:40:21.000104 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:20.999721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c65f767-4cpf7" event={"ID":"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33","Type":"ContainerStarted","Data":"1ef294ae60b517a8b8b0535fc9f4044b05b5213894493834d0368f9440cdf247"}
Jul 31 21:40:21.023690 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:21.023637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557c65f767-4cpf7" podStartSLOduration=2.02362062 podStartE2EDuration="2.02362062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:40:21.0230211 +0000 UTC m=+256.811354677" watchObservedRunningTime="2026-07-31 21:40:21.02362062 +0000 UTC m=+256.811954193"
Jul 31 21:40:30.299027 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:30.298955    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:30.299027 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:30.299013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:30.304693 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:30.304669    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:31.044399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:31.044369    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:40:31.102847 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:31.102796    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:40:31.219270 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:31.219238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:31.319696 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:31.319623    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:31.379230 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:31.379199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:55.255012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:55.254974    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:55.379960 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:55.379927    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:40:56.123571 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.123540    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d55c997f8-prfhm" podUID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" containerName="console" containerID="cri-o://c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a" gracePeriod=15
Jul 31 21:40:56.285324 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.285294    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"]
Jul 31 21:40:56.289279 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.289261    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.291791 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.291768    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrx9k\""
Jul 31 21:40:56.292052 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.292026    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 21:40:56.292337 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.292307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 21:40:56.299995 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.299939    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"]
Jul 31 21:40:56.364855 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.364832    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:40:56.367979 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.367958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.368071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.368004    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.368071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.368039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25grb\" (UniqueName: \"kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.468807 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468749    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.468807 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468803    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df8rz\" (UniqueName: \"kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.468963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468840    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.468963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.468963 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.469112 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.468990    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.469112 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469033    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert\") pod \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\" (UID: \"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365\") "
Jul 31 21:40:56.469206 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.469260 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.469310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469260    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:40:56.469310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469286    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config" (OuterVolumeSpecName: "console-config") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:40:56.469310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25grb\" (UniqueName: \"kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.469442 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca" (OuterVolumeSpecName: "service-ca") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:40:56.469571 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469548    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.469636 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469578    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-trusted-ca-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.469636 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469592    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.469636 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.469781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.469832 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.469775    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:40:56.471084 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.471062    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz" (OuterVolumeSpecName: "kube-api-access-df8rz") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "kube-api-access-df8rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:40:56.471273 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.471251    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:40:56.471385 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.471362    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" (UID: "27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:40:56.477449 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.477427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25grb\" (UniqueName: \"kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.570240 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.570218    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-oauth-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.570240 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.570237    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df8rz\" (UniqueName: \"kubernetes.io/projected/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-kube-api-access-df8rz\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.570340 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.570246    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.570340 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.570257    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365-console-oauth-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:40:56.601366 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.601347    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:40:56.725039 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:56.725014    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"]
Jul 31 21:40:56.726894 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:40:56.726870    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44eeb9ac_acde_4aaf_bfff_2028d25dc70d.slice/crio-5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3 WatchSource:0}: Error finding container 5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3: Status 404 returned error can't find the container with id 5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3
Jul 31 21:40:57.146744 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.146715    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss" event={"ID":"44eeb9ac-acde-4aaf-bfff-2028d25dc70d","Type":"ContainerStarted","Data":"5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3"}
Jul 31 21:40:57.147972 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.147948    2568 generic.go:356] "Generic (PLEG): container finished" podID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" containerID="c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a" exitCode=0
Jul 31 21:40:57.148069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.147995    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d55c997f8-prfhm"
Jul 31 21:40:57.148069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.148009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d55c997f8-prfhm" event={"ID":"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365","Type":"ContainerDied","Data":"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"}
Jul 31 21:40:57.148069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.148040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d55c997f8-prfhm" event={"ID":"27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365","Type":"ContainerDied","Data":"beb2aa6f602694a60f59614971e8ba5b88d31cd46deb2b32b799ce031d42187a"}
Jul 31 21:40:57.148069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.148066    2568 scope.go:117] "RemoveContainer" containerID="c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"
Jul 31 21:40:57.156097 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.156077    2568 scope.go:117] "RemoveContainer" containerID="c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"
Jul 31 21:40:57.156325 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:40:57.156310    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a\": container with ID starting with c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a not found: ID does not exist" containerID="c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"
Jul 31 21:40:57.156363 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.156332    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a"} err="failed to get container status \"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a\": rpc error: code = NotFound desc = could not find container \"c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a\": container with ID starting with c1fcdc00655b6434b6d65934e8cb1d32d282bbb633a59edc5b45ed0fe0cb549a not found: ID does not exist"
Jul 31 21:40:57.170092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.170068    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:40:57.172840 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:57.172806    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d55c997f8-prfhm"]
Jul 31 21:40:58.757117 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:40:58.757086    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" path="/var/lib/kubelet/pods/27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365/volumes"
Jul 31 21:41:03.176982 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:03.176949    2568 generic.go:356] "Generic (PLEG): container finished" podID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerID="80ea1e63cfed255173f4e05fc972cb5f3ffb6dc173e7c5426c4a1d7fa00fd626" exitCode=0
Jul 31 21:41:03.177324 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:03.177039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss" event={"ID":"44eeb9ac-acde-4aaf-bfff-2028d25dc70d","Type":"ContainerDied","Data":"80ea1e63cfed255173f4e05fc972cb5f3ffb6dc173e7c5426c4a1d7fa00fd626"}
Jul 31 21:41:05.029033 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:05.029007    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 21:41:05.186480 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:05.186449    2568 generic.go:356] "Generic (PLEG): container finished" podID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerID="0d0038b6eb7c9c1b83ad22fbfb446e76a5ddef816ed84d4fbb0d6077e43c0cd9" exitCode=0
Jul 31 21:41:05.186576 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:05.186525    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss" event={"ID":"44eeb9ac-acde-4aaf-bfff-2028d25dc70d","Type":"ContainerDied","Data":"0d0038b6eb7c9c1b83ad22fbfb446e76a5ddef816ed84d4fbb0d6077e43c0cd9"}
Jul 31 21:41:12.219626 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:12.219597    2568 generic.go:356] "Generic (PLEG): container finished" podID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerID="ac80bb31b8db1012c1b9cc0e61b942fc945ac2dfb0aa86557b084268c1b41385" exitCode=0
Jul 31 21:41:12.219953 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:12.219669    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss" event={"ID":"44eeb9ac-acde-4aaf-bfff-2028d25dc70d","Type":"ContainerDied","Data":"ac80bb31b8db1012c1b9cc0e61b942fc945ac2dfb0aa86557b084268c1b41385"}
Jul 31 21:41:13.347104 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.347080    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:41:13.514183 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.514159    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25grb\" (UniqueName: \"kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb\") pod \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") "
Jul 31 21:41:13.514294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.514192    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle\") pod \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") "
Jul 31 21:41:13.514294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.514261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util\") pod \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\" (UID: \"44eeb9ac-acde-4aaf-bfff-2028d25dc70d\") "
Jul 31 21:41:13.514876 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.514843    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle" (OuterVolumeSpecName: "bundle") pod "44eeb9ac-acde-4aaf-bfff-2028d25dc70d" (UID: "44eeb9ac-acde-4aaf-bfff-2028d25dc70d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:13.516328 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.516301    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb" (OuterVolumeSpecName: "kube-api-access-25grb") pod "44eeb9ac-acde-4aaf-bfff-2028d25dc70d" (UID: "44eeb9ac-acde-4aaf-bfff-2028d25dc70d"). InnerVolumeSpecName "kube-api-access-25grb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:41:13.519255 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.519236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util" (OuterVolumeSpecName: "util") pod "44eeb9ac-acde-4aaf-bfff-2028d25dc70d" (UID: "44eeb9ac-acde-4aaf-bfff-2028d25dc70d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:13.615434 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.615405    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:13.615434 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.615434    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25grb\" (UniqueName: \"kubernetes.io/projected/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-kube-api-access-25grb\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:13.615434 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:13.615443    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eeb9ac-acde-4aaf-bfff-2028d25dc70d-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:14.229210 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:14.229183    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss"
Jul 31 21:41:14.229378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:14.229186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dnxss" event={"ID":"44eeb9ac-acde-4aaf-bfff-2028d25dc70d","Type":"ContainerDied","Data":"5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3"}
Jul 31 21:41:14.229378 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:14.229302    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ce9a749066a540340fc033d0829e182ace3a52e0c0b74bdefddf627acd0b7f3"
Jul 31 21:41:17.607330 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:17.607289    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:19.038993 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:19.038962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:21.218423 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:21.218375    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:21.301620 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:21.301594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:23.489090 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:23.489047    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:23.586414 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:23.586377    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:24.146940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.146910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:24.325654 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.325627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:24.477154 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477093    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"]
Jul 31 21:41:24.477469 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477455    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="extract"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477471    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="extract"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477483    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" containerName="console"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477490    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" containerName="console"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477500    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="util"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477508    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="util"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477515    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="pull"
Jul 31 21:41:24.477517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477521    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="pull"
Jul 31 21:41:24.477717 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477577    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="27bf1176-87ac-4ef4-9c5b-5a2e9c6d6365" containerName="console"
Jul 31 21:41:24.477717 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.477587    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="44eeb9ac-acde-4aaf-bfff-2028d25dc70d" containerName="extract"
Jul 31 21:41:24.519334 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.519310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"]
Jul 31 21:41:24.519636 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.519400    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.526327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.526308    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 21:41:24.526876 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.526862    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrx9k\""
Jul 31 21:41:24.527181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.527164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 21:41:24.604048 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.604024    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwx89\" (UniqueName: \"kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.604134 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.604093    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.604174 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.604141    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.704531 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.704507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.704640 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.704539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.704640 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.704569    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwx89\" (UniqueName: \"kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.704874 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.704858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.704954 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.704910    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.734552 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.734497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwx89\" (UniqueName: \"kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.827868 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.827847    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:24.973494 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:24.973466    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"]
Jul 31 21:41:24.975474 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:41:24.975452    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb4c20d_4af0_410a_842c_572922a0978d.slice/crio-7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf WatchSource:0}: Error finding container 7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf: Status 404 returned error can't find the container with id 7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf
Jul 31 21:41:25.275729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:25.275659    2568 generic.go:356] "Generic (PLEG): container finished" podID="adb4c20d-4af0-410a-842c-572922a0978d" containerID="d59193a876ea704ae6b369af8484320a21364581bd66250c10a5babfb92c1a2f" exitCode=0
Jul 31 21:41:25.275861 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:25.275751    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp" event={"ID":"adb4c20d-4af0-410a-842c-572922a0978d","Type":"ContainerDied","Data":"d59193a876ea704ae6b369af8484320a21364581bd66250c10a5babfb92c1a2f"}
Jul 31 21:41:25.275861 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:25.275828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp" event={"ID":"adb4c20d-4af0-410a-842c-572922a0978d","Type":"ContainerStarted","Data":"7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf"}
Jul 31 21:41:25.276726 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:25.276710    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:41:25.848274 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:25.848243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:26.233210 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:26.233134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:28.290289 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:28.290253    2568 generic.go:356] "Generic (PLEG): container finished" podID="adb4c20d-4af0-410a-842c-572922a0978d" containerID="c34f0028dec38e032da2249db16206e5d15e2d5aca251735073f8eb4fbbafbac" exitCode=0
Jul 31 21:41:28.290738 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:28.290357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp" event={"ID":"adb4c20d-4af0-410a-842c-572922a0978d","Type":"ContainerDied","Data":"c34f0028dec38e032da2249db16206e5d15e2d5aca251735073f8eb4fbbafbac"}
Jul 31 21:41:28.395102 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:28.395073    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:28.494283 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:28.494238    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:29.297040 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:29.297010    2568 generic.go:356] "Generic (PLEG): container finished" podID="adb4c20d-4af0-410a-842c-572922a0978d" containerID="46f5ba4d57cd1d4a6736da3996b2bc31cf8a3aa7c5ccdf7b15a2e2abcc8c7b1c" exitCode=0
Jul 31 21:41:29.297400 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:29.297050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp" event={"ID":"adb4c20d-4af0-410a-842c-572922a0978d","Type":"ContainerDied","Data":"46f5ba4d57cd1d4a6736da3996b2bc31cf8a3aa7c5ccdf7b15a2e2abcc8c7b1c"}
Jul 31 21:41:30.432347 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.432323    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:30.447688 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.447669    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util\") pod \"adb4c20d-4af0-410a-842c-572922a0978d\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") "
Jul 31 21:41:30.447743 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.447724    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwx89\" (UniqueName: \"kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89\") pod \"adb4c20d-4af0-410a-842c-572922a0978d\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") "
Jul 31 21:41:30.447782 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.447759    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle\") pod \"adb4c20d-4af0-410a-842c-572922a0978d\" (UID: \"adb4c20d-4af0-410a-842c-572922a0978d\") "
Jul 31 21:41:30.448216 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.448188    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle" (OuterVolumeSpecName: "bundle") pod "adb4c20d-4af0-410a-842c-572922a0978d" (UID: "adb4c20d-4af0-410a-842c-572922a0978d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:30.449569 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.449549    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89" (OuterVolumeSpecName: "kube-api-access-lwx89") pod "adb4c20d-4af0-410a-842c-572922a0978d" (UID: "adb4c20d-4af0-410a-842c-572922a0978d"). InnerVolumeSpecName "kube-api-access-lwx89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:41:30.452875 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.452852    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util" (OuterVolumeSpecName: "util") pod "adb4c20d-4af0-410a-842c-572922a0978d" (UID: "adb4c20d-4af0-410a-842c-572922a0978d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:30.548527 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.548504    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:30.548527 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.548523    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb4c20d-4af0-410a-842c-572922a0978d-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:30.548644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.548532    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwx89\" (UniqueName: \"kubernetes.io/projected/adb4c20d-4af0-410a-842c-572922a0978d-kube-api-access-lwx89\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:30.600630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.600566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:30.700638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:30.700617    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:31.306935 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:31.306911    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp"
Jul 31 21:41:31.307053 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:31.306927    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8kzxp" event={"ID":"adb4c20d-4af0-410a-842c-572922a0978d","Type":"ContainerDied","Data":"7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf"}
Jul 31 21:41:31.307053 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:31.306980    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d8fef62dd235be450a79080f118409d150ac016fa8caa0982681730b09d12cf"
Jul 31 21:41:33.455930 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.455886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:33.612233 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612201    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t68dq"]
Jul 31 21:41:33.612525 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612513    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="extract"
Jul 31 21:41:33.612577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612527    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="extract"
Jul 31 21:41:33.612577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612537    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="util"
Jul 31 21:41:33.612577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612542    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="util"
Jul 31 21:41:33.612577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612559    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="pull"
Jul 31 21:41:33.612577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612565    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="pull"
Jul 31 21:41:33.612733 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.612626    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb4c20d-4af0-410a-842c-572922a0978d" containerName="extract"
Jul 31 21:41:33.615310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.615298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.617970 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.617949    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 21:41:33.618094 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.618056    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rzrxm\""
Jul 31 21:41:33.618674 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.618659    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 21:41:33.627979 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.627957    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t68dq"]
Jul 31 21:41:33.674293 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.674270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hnqr\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-kube-api-access-4hnqr\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.674438 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.674314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-bound-sa-token\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.775215 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.775191    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hnqr\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-kube-api-access-4hnqr\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.775325 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.775228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-bound-sa-token\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.782997 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.782972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-bound-sa-token\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.783153 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.783133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hnqr\" (UniqueName: \"kubernetes.io/projected/59045665-74c2-433b-b533-c3d0369d188e-kube-api-access-4hnqr\") pod \"cert-manager-55b4d954d5-t68dq\" (UID: \"59045665-74c2-433b-b533-c3d0369d188e\") " pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:33.936185 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:33.936155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-t68dq"
Jul 31 21:41:34.064670 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:34.064644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-t68dq"]
Jul 31 21:41:34.067032 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:41:34.067000    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59045665_74c2_433b_b533_c3d0369d188e.slice/crio-88da76f52bbac2f503dde31e4163cafdbc7bd61252064ee71f57f8be4c3a5c8e WatchSource:0}: Error finding container 88da76f52bbac2f503dde31e4163cafdbc7bd61252064ee71f57f8be4c3a5c8e: Status 404 returned error can't find the container with id 88da76f52bbac2f503dde31e4163cafdbc7bd61252064ee71f57f8be4c3a5c8e
Jul 31 21:41:34.321244 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:34.321184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t68dq" event={"ID":"59045665-74c2-433b-b533-c3d0369d188e","Type":"ContainerStarted","Data":"88da76f52bbac2f503dde31e4163cafdbc7bd61252064ee71f57f8be4c3a5c8e"}
Jul 31 21:41:34.610419 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:34.610356    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:34.711672 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:34.711644    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:37.337785 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:37.337740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-t68dq" event={"ID":"59045665-74c2-433b-b533-c3d0369d188e","Type":"ContainerStarted","Data":"c1793d1b8ba74466a466b03b27a83fc885a6f2d66de150af0598527b1d025234"}
Jul 31 21:41:37.358933 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:37.358883    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-t68dq" podStartSLOduration=2.016649397 podStartE2EDuration="4.358868772s" totalImagesPullingTime="2.342219375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:41:37.357000739 +0000 UTC m=+333.145334310" watchObservedRunningTime="2026-07-31 21:41:37.358868772 +0000 UTC m=+333.147202343"
Jul 31 21:41:40.396451 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:40.396420    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:40.494673 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:40.494642    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:42.086472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.086420    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"]
Jul 31 21:41:42.090166 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.090146    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.092404 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.092378    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 21:41:42.092849 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.092828    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 21:41:42.092908 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.092828    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrx9k\""
Jul 31 21:41:42.098272 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.098245    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"]
Jul 31 21:41:42.146860 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.146832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.146969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.146902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.146969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.146945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mqm\" (UniqueName: \"kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.247565 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.247530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.247767 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.247577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mqm\" (UniqueName: \"kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.247767 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.247661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.247941 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.247920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.248102 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.248075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.256256 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.256224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mqm\" (UniqueName: \"kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.401383 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.401323    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:42.534582 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.534552    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"]
Jul 31 21:41:42.537128 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:41:42.537094    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c69be5_1fe2_4ae0_ab2f_5843ddbd665a.slice/crio-3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66 WatchSource:0}: Error finding container 3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66: Status 404 returned error can't find the container with id 3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66
Jul 31 21:41:42.761146 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:42.761124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:43.368630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:43.368557    2568 generic.go:356] "Generic (PLEG): container finished" podID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerID="b6214902dbc8bd3f669737acb15d1570bb7176117afa60909ca3cab46ba21dcd" exitCode=0
Jul 31 21:41:43.368630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:43.368613    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7" event={"ID":"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a","Type":"ContainerDied","Data":"b6214902dbc8bd3f669737acb15d1570bb7176117afa60909ca3cab46ba21dcd"}
Jul 31 21:41:43.369046 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:43.368650    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7" event={"ID":"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a","Type":"ContainerStarted","Data":"3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66"}
Jul 31 21:41:44.374725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:44.374642    2568 generic.go:356] "Generic (PLEG): container finished" podID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerID="4a20be68dd3f4f0aa8af60c71c90c6622f5587317aeaf008d3ea197f2631aa29" exitCode=0
Jul 31 21:41:44.375079 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:44.374727    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7" event={"ID":"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a","Type":"ContainerDied","Data":"4a20be68dd3f4f0aa8af60c71c90c6622f5587317aeaf008d3ea197f2631aa29"}
Jul 31 21:41:45.380803 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:45.380769    2568 generic.go:356] "Generic (PLEG): container finished" podID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerID="78222f1f9c8f946c185de5caac25a595c429015fad15a286f5d70baddc741404" exitCode=0
Jul 31 21:41:45.381175 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:45.380858    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7" event={"ID":"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a","Type":"ContainerDied","Data":"78222f1f9c8f946c185de5caac25a595c429015fad15a286f5d70baddc741404"}
Jul 31 21:41:46.512261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.512239    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:46.581353 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.581324    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6mqm\" (UniqueName: \"kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm\") pod \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") "
Jul 31 21:41:46.581488 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.581437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle\") pod \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") "
Jul 31 21:41:46.581488 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.581464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util\") pod \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\" (UID: \"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a\") "
Jul 31 21:41:46.582061 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.582040    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle" (OuterVolumeSpecName: "bundle") pod "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" (UID: "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:46.583370 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.583350    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm" (OuterVolumeSpecName: "kube-api-access-q6mqm") pod "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" (UID: "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a"). InnerVolumeSpecName "kube-api-access-q6mqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:41:46.587358 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.587339    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util" (OuterVolumeSpecName: "util") pod "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" (UID: "47c69be5-1fe2-4ae0-ab2f-5843ddbd665a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:41:46.682512 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.682461    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:46.682512 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.682485    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:46.682512 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:46.682494    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6mqm\" (UniqueName: \"kubernetes.io/projected/47c69be5-1fe2-4ae0-ab2f-5843ddbd665a-kube-api-access-q6mqm\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:41:47.393649 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:47.393621    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7"
Jul 31 21:41:47.393870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:47.393653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd5wg7" event={"ID":"47c69be5-1fe2-4ae0-ab2f-5843ddbd665a","Type":"ContainerDied","Data":"3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66"}
Jul 31 21:41:47.393870 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:47.393708    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c4174a14fb35f086fac7089fd7b80fa98fe97c88e977a73481f7dce28c7ec66"
Jul 31 21:41:56.888015 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:56.887930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:56.981983 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:56.981951    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:57.513851 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:57.513800    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.029231 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.029201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.133397 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.133366    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.159434 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159407    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"]
Jul 31 21:41:58.159770 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159755    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="extract"
Jul 31 21:41:58.159838 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159773    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="extract"
Jul 31 21:41:58.159838 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159784    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="util"
Jul 31 21:41:58.159838 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159789    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="util"
Jul 31 21:41:58.159838 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159831    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="pull"
Jul 31 21:41:58.159962 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159840    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="pull"
Jul 31 21:41:58.159962 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.159913    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="47c69be5-1fe2-4ae0-ab2f-5843ddbd665a" containerName="extract"
Jul 31 21:41:58.163028 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.163007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.166065 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.166048    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 21:41:58.166152 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.166107    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 21:41:58.166344 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.166327    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 21:41:58.166421 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.166367    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wpdq\""
Jul 31 21:41:58.166586 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.166572    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 21:41:58.182862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.182841    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"]
Jul 31 21:41:58.269436 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.269413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.269534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.269460    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbb2\" (UniqueName: \"kubernetes.io/projected/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-kube-api-access-mxbb2\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.269534 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.269484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.269621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.269535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.269621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.269588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.290869 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.290801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.370132 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbb2\" (UniqueName: \"kubernetes.io/projected/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-kube-api-access-mxbb2\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.370219 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.370219 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.370219 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370198    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.370385 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.370489 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.370471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.372526 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.372493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.372675 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.372657    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.372808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.372790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.379069 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.379049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbb2\" (UniqueName: \"kubernetes.io/projected/5aa927cc-ad82-4db4-9ff8-fb6a71af508d-kube-api-access-mxbb2\") pod \"opendatahub-operator-controller-manager-67685b9c4d-lhvmb\" (UID: \"5aa927cc-ad82-4db4-9ff8-fb6a71af508d\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.392212 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.392191    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.472493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.472469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:41:58.544095 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.543997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.612636 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.612613    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"]
Jul 31 21:41:58.616202 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:41:58.616171    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa927cc_ad82_4db4_9ff8_fb6a71af508d.slice/crio-87004c6b2d62d0c863f8a9c7357f9b32d590aeaba0dae76d50b1170276966c32 WatchSource:0}: Error finding container 87004c6b2d62d0c863f8a9c7357f9b32d590aeaba0dae76d50b1170276966c32: Status 404 returned error can't find the container with id 87004c6b2d62d0c863f8a9c7357f9b32d590aeaba0dae76d50b1170276966c32
Jul 31 21:41:58.649238 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.649197    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.743462 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.743429    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:58.842736 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:58.842662    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:59.399557 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:59.399520    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:41:59.452682 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:41:59.452643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb" event={"ID":"5aa927cc-ad82-4db4-9ff8-fb6a71af508d","Type":"ContainerStarted","Data":"87004c6b2d62d0c863f8a9c7357f9b32d590aeaba0dae76d50b1170276966c32"}
Jul 31 21:42:01.463254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:01.463224    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb" event={"ID":"5aa927cc-ad82-4db4-9ff8-fb6a71af508d","Type":"ContainerStarted","Data":"78ebb32da0dcaa31114b6f6cad7c1b39c03ab367f2afb1c994cf0c4476a547eb"}
Jul 31 21:42:03.162886 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:03.162851    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:03.272456 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:03.272413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:03.474349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:03.474287    2568 generic.go:356] "Generic (PLEG): container finished" podID="5aa927cc-ad82-4db4-9ff8-fb6a71af508d" containerID="78ebb32da0dcaa31114b6f6cad7c1b39c03ab367f2afb1c994cf0c4476a547eb" exitCode=0
Jul 31 21:42:03.474349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:03.474343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb" event={"ID":"5aa927cc-ad82-4db4-9ff8-fb6a71af508d","Type":"ContainerDied","Data":"78ebb32da0dcaa31114b6f6cad7c1b39c03ab367f2afb1c994cf0c4476a547eb"}
Jul 31 21:42:04.480878 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:04.480841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb" event={"ID":"5aa927cc-ad82-4db4-9ff8-fb6a71af508d","Type":"ContainerStarted","Data":"39933c9956dedfa2598dc138cde8157af5c5f1e4d176d52714888ff45a8740de"}
Jul 31 21:42:04.481305 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:04.481064    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:42:04.507076 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:04.507014    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb" podStartSLOduration=2.345905086 podStartE2EDuration="6.506999476s" totalImagesPullingTime="3.139840948s" totalInitContainerRuntime="1.021253442s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:41:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:04.505552964 +0000 UTC m=+360.293886536" watchObservedRunningTime="2026-07-31 21:42:04.506999476 +0000 UTC m=+360.295333047"
Jul 31 21:42:15.486781 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:15.486749    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-lhvmb"
Jul 31 21:42:17.831597 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:17.831563    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:18.479402 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:18.479369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:19.141607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.141576    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tgtdz"]
Jul 31 21:42:19.150996 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.150968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.153628 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.153607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5hxq4\""
Jul 31 21:42:19.153925 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.153910    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 31 21:42:19.171525 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.171504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tgtdz"]
Jul 31 21:42:19.278562 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.278537    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:19.333688 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.333666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.333849 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.333721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlkcx\" (UniqueName: \"kubernetes.io/projected/4c4fd200-f8bd-49fc-b918-6249a7e610e4-kube-api-access-xlkcx\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.411961 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.411887    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:19.434966 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.434939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlkcx\" (UniqueName: \"kubernetes.io/projected/4c4fd200-f8bd-49fc-b918-6249a7e610e4-kube-api-access-xlkcx\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.435091 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.435001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.435162 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:42:19.435111    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 31 21:42:19.435220 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:42:19.435173    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert podName:4c4fd200-f8bd-49fc-b918-6249a7e610e4 nodeName:}" failed. No retries permitted until 2026-07-31 21:42:19.935158288 +0000 UTC m=+375.723491839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert") pod "odh-model-controller-7998c67dc4-tgtdz" (UID: "4c4fd200-f8bd-49fc-b918-6249a7e610e4") : secret "odh-model-controller-webhook-cert" not found
Jul 31 21:42:19.464245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.464222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlkcx\" (UniqueName: \"kubernetes.io/projected/4c4fd200-f8bd-49fc-b918-6249a7e610e4-kube-api-access-xlkcx\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.679796 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.679719    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:19.940241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.940186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:19.942716 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:19.942694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4fd200-f8bd-49fc-b918-6249a7e610e4-cert\") pod \"odh-model-controller-7998c67dc4-tgtdz\" (UID: \"4c4fd200-f8bd-49fc-b918-6249a7e610e4\") " pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:20.061083 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.061044    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:20.221786 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.221758    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tgtdz"]
Jul 31 21:42:20.223170 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:20.223145    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4fd200_f8bd_49fc_b918_6249a7e610e4.slice/crio-adcdeca2c18b3e7a8c0b7a2ced4f3e1d6b3623aaf64a10142623927fe8ebe005 WatchSource:0}: Error finding container adcdeca2c18b3e7a8c0b7a2ced4f3e1d6b3623aaf64a10142623927fe8ebe005: Status 404 returned error can't find the container with id adcdeca2c18b3e7a8c0b7a2ced4f3e1d6b3623aaf64a10142623927fe8ebe005
Jul 31 21:42:20.486227 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.486165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:20.541594 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.541565    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r92nb"]
Jul 31 21:42:20.546144 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.546125    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.548854 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.548836    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 31 21:42:20.548917 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.548888    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zfhpm\""
Jul 31 21:42:20.558570 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.558545    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz" event={"ID":"4c4fd200-f8bd-49fc-b918-6249a7e610e4","Type":"ContainerStarted","Data":"adcdeca2c18b3e7a8c0b7a2ced4f3e1d6b3623aaf64a10142623927fe8ebe005"}
Jul 31 21:42:20.569384 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.569358    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r92nb"]
Jul 31 21:42:20.646435 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.646411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7744d428-f259-4637-98c2-0986d2525009-tls-certs\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.646520 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.646453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rfn\" (UniqueName: \"kubernetes.io/projected/7744d428-f259-4637-98c2-0986d2525009-kube-api-access-q8rfn\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.747451 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.747431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rfn\" (UniqueName: \"kubernetes.io/projected/7744d428-f259-4637-98c2-0986d2525009-kube-api-access-q8rfn\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.747531 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.747499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7744d428-f259-4637-98c2-0986d2525009-tls-certs\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.749837 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.749793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7744d428-f259-4637-98c2-0986d2525009-tls-certs\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.775943 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.775918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rfn\" (UniqueName: \"kubernetes.io/projected/7744d428-f259-4637-98c2-0986d2525009-kube-api-access-q8rfn\") pod \"model-serving-api-54d89bd5fc-r92nb\" (UID: \"7744d428-f259-4637-98c2-0986d2525009\") " pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:20.832202 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.832175    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:20.856444 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:20.856421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:21.019777 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:21.019746    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r92nb"]
Jul 31 21:42:21.022826 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:21.022786    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7744d428_f259_4637_98c2_0986d2525009.slice/crio-afc0dd6ff292a5bc259da2a51b01fe849d1970a1c1514f148fe3ec928d6d6e3c WatchSource:0}: Error finding container afc0dd6ff292a5bc259da2a51b01fe849d1970a1c1514f148fe3ec928d6d6e3c: Status 404 returned error can't find the container with id afc0dd6ff292a5bc259da2a51b01fe849d1970a1c1514f148fe3ec928d6d6e3c
Jul 31 21:42:21.564251 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:21.564209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb" event={"ID":"7744d428-f259-4637-98c2-0986d2525009","Type":"ContainerStarted","Data":"afc0dd6ff292a5bc259da2a51b01fe849d1970a1c1514f148fe3ec928d6d6e3c"}
Jul 31 21:42:24.561540 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.561504    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:24.580774 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.580737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz" event={"ID":"4c4fd200-f8bd-49fc-b918-6249a7e610e4","Type":"ContainerStarted","Data":"b1276a20fe02d1c13981b89c927809b43570603d79b7a207474372388448cb9c"}
Jul 31 21:42:24.580940 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.580848    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:24.582242 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.582221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb" event={"ID":"7744d428-f259-4637-98c2-0986d2525009","Type":"ContainerStarted","Data":"c7894667b74ff29e18bfd984eae9229ec7b568111d1c507c2891da0653ba8fcb"}
Jul 31 21:42:24.582332 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.582260    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:24.603574 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.603546    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64667dffd7-vz949"]
Jul 31 21:42:24.606975 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.606960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.613457 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.613439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 21:42:24.613517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.613439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 21:42:24.627710 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.627691    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64667dffd7-vz949"]
Jul 31 21:42:24.637183 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.637138    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz" podStartSLOduration=1.980902445 podStartE2EDuration="5.637126518s" totalImagesPullingTime="3.656224073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:24.636179258 +0000 UTC m=+380.424512830" watchObservedRunningTime="2026-07-31 21:42:24.637126518 +0000 UTC m=+380.425460117"
Jul 31 21:42:24.714053 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.714013    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb" podStartSLOduration=1.816104131 podStartE2EDuration="4.714000314s" totalImagesPullingTime="2.897896183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:24.71212003 +0000 UTC m=+380.500453601" watchObservedRunningTime="2026-07-31 21:42:24.714000314 +0000 UTC m=+380.502333886"
Jul 31 21:42:24.786105 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.786080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tls-certs\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.786205 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.786148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tmp\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.786205 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.786178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfsf\" (UniqueName: \"kubernetes.io/projected/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-kube-api-access-hwfsf\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.798005 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.797982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:24.887301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.887232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tmp\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.887301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.887283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfsf\" (UniqueName: \"kubernetes.io/projected/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-kube-api-access-hwfsf\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.887477 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.887316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tls-certs\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.889551 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.889527    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tmp\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.889723 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.889702    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-tls-certs\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.901068 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.901049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfsf\" (UniqueName: \"kubernetes.io/projected/c6a2f468-fdd6-4fa7-83ca-89c032bf7073-kube-api-access-hwfsf\") pod \"kube-auth-proxy-64667dffd7-vz949\" (UID: \"c6a2f468-fdd6-4fa7-83ca-89c032bf7073\") " pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:24.915750 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:24.915718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949"
Jul 31 21:42:25.063218 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:25.063189    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64667dffd7-vz949"]
Jul 31 21:42:25.065319 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:25.065288    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a2f468_fdd6_4fa7_83ca_89c032bf7073.slice/crio-4be48ecdb817326fa7c71779d5c51cdbda3f81b108ba89f463f5920bc0a56a17 WatchSource:0}: Error finding container 4be48ecdb817326fa7c71779d5c51cdbda3f81b108ba89f463f5920bc0a56a17: Status 404 returned error can't find the container with id 4be48ecdb817326fa7c71779d5c51cdbda3f81b108ba89f463f5920bc0a56a17
Jul 31 21:42:25.588346 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:25.588310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949" event={"ID":"c6a2f468-fdd6-4fa7-83ca-89c032bf7073","Type":"ContainerStarted","Data":"4be48ecdb817326fa7c71779d5c51cdbda3f81b108ba89f463f5920bc0a56a17"}
Jul 31 21:42:26.815993 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.815957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:26.826403 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.826373    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"]
Jul 31 21:42:26.830750 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.830731    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.833724 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.833705    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 21:42:26.834025 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.834004    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 21:42:26.834108 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.834021    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h8gxb\""
Jul 31 21:42:26.834453 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.834434    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 21:42:26.834580 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.834473    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 21:42:26.846854 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.846801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"]
Jul 31 21:42:26.904472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5457c8cf-032d-4200-92ea-c60d8238140f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw575\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-kube-api-access-lw575\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.904725 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.904660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:26.923066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:26.923034    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:27.005517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5457c8cf-032d-4200-92ea-c60d8238140f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005638 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw575\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-kube-api-access-lw575\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.005808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.005733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.006384 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.006363    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.008074 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.008046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5457c8cf-032d-4200-92ea-c60d8238140f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.008409 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.008389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.008485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.008390    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.008485 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.008426    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5457c8cf-032d-4200-92ea-c60d8238140f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.020973 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.020951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw575\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-kube-api-access-lw575\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.021425 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.021409    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5457c8cf-032d-4200-92ea-c60d8238140f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bprp5\" (UID: \"5457c8cf-032d-4200-92ea-c60d8238140f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.141853 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.141765    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:27.876248 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:27.876225    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"]
Jul 31 21:42:27.878159 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:27.878133    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5457c8cf_032d_4200_92ea_c60d8238140f.slice/crio-a176979de74ed37c0bd74a0aab9d8eb7728830fcf59151c7b483591e9e0d81dd WatchSource:0}: Error finding container a176979de74ed37c0bd74a0aab9d8eb7728830fcf59151c7b483591e9e0d81dd: Status 404 returned error can't find the container with id a176979de74ed37c0bd74a0aab9d8eb7728830fcf59151c7b483591e9e0d81dd
Jul 31 21:42:28.608344 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:28.608309    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5" event={"ID":"5457c8cf-032d-4200-92ea-c60d8238140f","Type":"ContainerStarted","Data":"a176979de74ed37c0bd74a0aab9d8eb7728830fcf59151c7b483591e9e0d81dd"}
Jul 31 21:42:28.610264 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:28.610232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949" event={"ID":"c6a2f468-fdd6-4fa7-83ca-89c032bf7073","Type":"ContainerStarted","Data":"a2fd726c81a14e22e3a8785e0d9f7934b34a6ca1114de1f642285a40b27694f8"}
Jul 31 21:42:28.640997 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:28.640947    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64667dffd7-vz949" podStartSLOduration=1.975141867 podStartE2EDuration="4.640929024s" totalImagesPullingTime="2.665787157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:28.638685687 +0000 UTC m=+384.427019259" watchObservedRunningTime="2026-07-31 21:42:28.640929024 +0000 UTC m=+384.429262597"
Jul 31 21:42:28.892000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:28.891925    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:30.123183 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.123151    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:30.177175 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.177137    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:42:30.177293 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.177214    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:42:30.270482 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.270397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:30.623607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.623578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5" event={"ID":"5457c8cf-032d-4200-92ea-c60d8238140f","Type":"ContainerStarted","Data":"59efab2b2d2e675411ea49f065f3e81ebf9443b5cf912bacf0e15e98c01ecf0a"}
Jul 31 21:42:30.623788 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.623660    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:30.652335 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.652308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:30.689240 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.689199    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5" podStartSLOduration=2.392441823 podStartE2EDuration="4.689183187s" totalImagesPullingTime="2.296741364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:30.686007365 +0000 UTC m=+386.474340937" watchObservedRunningTime="2026-07-31 21:42:30.689183187 +0000 UTC m=+386.477516758"
Jul 31 21:42:30.979246 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:30.979155    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:31.125171 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.125108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:31.462113 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.462066    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:31.601218 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.601185    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:31.630461 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.630423    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-bprp5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:42:31.630576 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.630501    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5" podUID="5457c8cf-032d-4200-92ea-c60d8238140f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:42:31.703649 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:31.703604    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:32.283221 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.283187    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"]
Jul 31 21:42:32.286925 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.286906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.289099 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.289080    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hjwx8\""
Jul 31 21:42:32.307896 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.307872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"]
Jul 31 21:42:32.333215 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.333189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:32.354932 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.354909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.354946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355031 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.354984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355051    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355330 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvlg\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-kube-api-access-knvlg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.355330 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.355236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455709 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455684    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knvlg\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-kube-api-access-knvlg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455808 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455988 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.455988 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.455961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456098 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456098 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456098 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456098 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456077    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456304 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456177    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456304 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.456484 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.456462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.458190 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.458170    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.458286 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.458268    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.463992 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.463965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.464206 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.464190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvlg\" (UniqueName: \"kubernetes.io/projected/e75ce6e6-7f07-44b5-8a69-6fa810f260a3-kube-api-access-knvlg\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2\" (UID: \"e75ce6e6-7f07-44b5-8a69-6fa810f260a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.533297 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.533243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:32.596721 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.596697    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:32.655230 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.655188    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:32.756662 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:32.756636    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75ce6e6_7f07_44b5_8a69_6fa810f260a3.slice/crio-05e070d1addd27dcf0604291e18e582dd5439e615ae813e442171fb842310164 WatchSource:0}: Error finding container 05e070d1addd27dcf0604291e18e582dd5439e615ae813e442171fb842310164: Status 404 returned error can't find the container with id 05e070d1addd27dcf0604291e18e582dd5439e615ae813e442171fb842310164
Jul 31 21:42:32.762270 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:32.762249    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"]
Jul 31 21:42:33.639706 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:33.639677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2" event={"ID":"e75ce6e6-7f07-44b5-8a69-6fa810f260a3","Type":"ContainerStarted","Data":"05e070d1addd27dcf0604291e18e582dd5439e615ae813e442171fb842310164"}
Jul 31 21:42:34.630097 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:34.630064    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bprp5"
Jul 31 21:42:35.516424 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.516387    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:42:35.516692 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.516459    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:42:35.516692 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.516487    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:42:35.590688 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.590669    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tgtdz"
Jul 31 21:42:35.594614 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.594593    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-r92nb"
Jul 31 21:42:35.653060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.653019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2" event={"ID":"e75ce6e6-7f07-44b5-8a69-6fa810f260a3","Type":"ContainerStarted","Data":"8a14dc6dc230ecb74a0f3b795b0d5407fc567400c7b59f40535abafd38f2a68e"}
Jul 31 21:42:35.695879 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:35.695785    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2" podStartSLOduration=0.938270686 podStartE2EDuration="3.695764394s" totalImagesPullingTime="2.757493708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:35.694674403 +0000 UTC m=+391.483007976" watchObservedRunningTime="2026-07-31 21:42:35.695764394 +0000 UTC m=+391.484097969"
Jul 31 21:42:36.597423 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:36.597384    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:36.602135 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:36.602109    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:36.658662 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:36.658633    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:36.659333 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:36.659316    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2"
Jul 31 21:42:53.525374 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.525332    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6dfc69bc-492sb"]
Jul 31 21:42:53.529249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.529220    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.548053 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.548025    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dfc69bc-492sb"]
Jul 31 21:42:53.598981 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.598955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:53.625964 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.625940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-trusted-ca-bundle\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.625986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-oauth-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.626052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626142 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.626095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626142 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.626132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-oauth-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626208 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.626155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2d5\" (UniqueName: \"kubernetes.io/projected/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-kube-api-access-gb2d5\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.626208 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.626181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-service-ca\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.696863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.696804    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:42:53.726622 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.726737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-oauth-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.726737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2d5\" (UniqueName: \"kubernetes.io/projected/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-kube-api-access-gb2d5\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.726737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726675    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-service-ca\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.726737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-trusted-ca-bundle\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.726953 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-oauth-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.727007 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.726971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.727527 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.727504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-oauth-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.727623 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.727580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-service-ca\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.727623 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.727580    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-trusted-ca-bundle\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.727724 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.727702    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.729085 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.729062    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-oauth-config\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.729177 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.729159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-console-serving-cert\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.734941 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.734919    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2d5\" (UniqueName: \"kubernetes.io/projected/22caa7a0-02ba-4b8e-ae81-5005ec6276ec-kube-api-access-gb2d5\") pod \"console-7c6dfc69bc-492sb\" (UID: \"22caa7a0-02ba-4b8e-ae81-5005ec6276ec\") " pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.839852 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.839791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:42:53.970761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:53.970738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dfc69bc-492sb"]
Jul 31 21:42:53.972459 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:42:53.972430    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22caa7a0_02ba_4b8e_ae81_5005ec6276ec.slice/crio-9fc941cbf9d28a0183c444678625a628c9b9df1fbf4173a2243cb4c0836230ed WatchSource:0}: Error finding container 9fc941cbf9d28a0183c444678625a628c9b9df1fbf4173a2243cb4c0836230ed: Status 404 returned error can't find the container with id 9fc941cbf9d28a0183c444678625a628c9b9df1fbf4173a2243cb4c0836230ed
Jul 31 21:42:54.756859 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:54.756829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dfc69bc-492sb" event={"ID":"22caa7a0-02ba-4b8e-ae81-5005ec6276ec","Type":"ContainerStarted","Data":"a80a10e60b881b16cad7a092afd534ec0e777cd84763f4823dbca4ac96c07e60"}
Jul 31 21:42:54.757191 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:54.756869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dfc69bc-492sb" event={"ID":"22caa7a0-02ba-4b8e-ae81-5005ec6276ec","Type":"ContainerStarted","Data":"9fc941cbf9d28a0183c444678625a628c9b9df1fbf4173a2243cb4c0836230ed"}
Jul 31 21:42:54.776501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:42:54.776453    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c6dfc69bc-492sb" podStartSLOduration=1.7764391389999998 podStartE2EDuration="1.776439139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:54.773810365 +0000 UTC m=+410.562143975" watchObservedRunningTime="2026-07-31 21:42:54.776439139 +0000 UTC m=+410.564772711"
Jul 31 21:43:03.840788 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:03.840748    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:43:03.841235 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:03.840828    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:43:03.845112 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:03.845091    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:43:04.810383 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:04.810352    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6dfc69bc-492sb"
Jul 31 21:43:04.865671 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:04.865633    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:43:04.993241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:04.993214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:05.090258 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:05.090193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:05.153525 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:05.153498    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:19.480876 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:19.480839    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:19.698519 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:19.698480    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:23.511641 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.511595    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"]
Jul 31 21:43:23.524507 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.524477    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.525477 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.525443    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"]
Jul 31 21:43:23.526934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.526909    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrx9k\""
Jul 31 21:43:23.527124 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.526906    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 21:43:23.527533 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.527512    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 21:43:23.608275 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.608250    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"]
Jul 31 21:43:23.611906 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.611890    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.621136 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.621118    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"]
Jul 31 21:43:23.669170 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.669147    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.669290 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.669229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.669290 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.669262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62t2s\" (UniqueName: \"kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.743416 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.743388    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"]
Jul 31 21:43:23.747166 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.747151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.758084 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.758065    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"]
Jul 31 21:43:23.769801 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.769920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62t2s\" (UniqueName: \"kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.769920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xffgg\" (UniqueName: \"kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.769920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.769920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769887    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.769920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.769903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.770215 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.770157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.770215 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.770181    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.778757 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.778734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62t2s\" (UniqueName: \"kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.811145 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.811120    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"]
Jul 31 21:43:23.814956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.814941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:23.824941 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.824923    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"]
Jul 31 21:43:23.835735 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.835716    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:23.870735 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.870875 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870745    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.870875 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtfqw\" (UniqueName: \"kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.870875 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xffgg\" (UniqueName: \"kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.871060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.871060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.870964    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.871249 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.871232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.871310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.871247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.880393 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.880365    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xffgg\" (UniqueName: \"kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.921148 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.921123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:23.972257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.972257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:23.972257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.972257 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:23.972481 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtfqw\" (UniqueName: \"kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.972481 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6tjv\" (UniqueName: \"kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:23.972647 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.972534    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"]
Jul 31 21:43:23.973331 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.973287    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.973331 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.973291    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:23.975173 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:23.975019    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8000833_05ba_4c1b_8ccd_c867d2ec328b.slice/crio-e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e WatchSource:0}: Error finding container e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e: Status 404 returned error can't find the container with id e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e
Jul 31 21:43:23.981787 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:23.981768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtfqw\" (UniqueName: \"kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:24.056005 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.055981    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:24.059884 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.059857    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"]
Jul 31 21:43:24.061246 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:24.061227    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c54d847_4dc5_4589_992d_2fc69958336f.slice/crio-1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4 WatchSource:0}: Error finding container 1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4: Status 404 returned error can't find the container with id 1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4
Jul 31 21:43:24.073282 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.073254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.073441 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.073422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.073573 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.073552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6tjv\" (UniqueName: \"kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.073712 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.073603    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.073887 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.073760    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.082795 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.082765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6tjv\" (UniqueName: \"kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.124923 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.124568    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:24.232561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.231066    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"]
Jul 31 21:43:24.233331 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:24.233301    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593e110a_2a33_43e7_9395_cdcaefb8ca7a.slice/crio-39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682 WatchSource:0}: Error finding container 39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682: Status 404 returned error can't find the container with id 39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682
Jul 31 21:43:24.286210 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.286186    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"]
Jul 31 21:43:24.299256 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:24.299232    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9700da_f36b_419f_a21c_55daaeb80c1b.slice/crio-14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81 WatchSource:0}: Error finding container 14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81: Status 404 returned error can't find the container with id 14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81
Jul 31 21:43:24.906648 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.906618    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerID="8ce3e32f4d74a44c31d84644ffa9ebad84ed8d3483f2b8ffeaf17f6b9430255c" exitCode=0
Jul 31 21:43:24.907038 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.906700    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws" event={"ID":"c8000833-05ba-4c1b-8ccd-c867d2ec328b","Type":"ContainerDied","Data":"8ce3e32f4d74a44c31d84644ffa9ebad84ed8d3483f2b8ffeaf17f6b9430255c"}
Jul 31 21:43:24.907038 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.906743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws" event={"ID":"c8000833-05ba-4c1b-8ccd-c867d2ec328b","Type":"ContainerStarted","Data":"e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e"}
Jul 31 21:43:24.908254 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.908231    2568 generic.go:356] "Generic (PLEG): container finished" podID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerID="538fcab638afee3e77b7729ed1d0e63d7e0fd1c99db88adbd1e961bd2999777a" exitCode=0
Jul 31 21:43:24.908352 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.908320    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb" event={"ID":"593e110a-2a33-43e7-9395-cdcaefb8ca7a","Type":"ContainerDied","Data":"538fcab638afee3e77b7729ed1d0e63d7e0fd1c99db88adbd1e961bd2999777a"}
Jul 31 21:43:24.908412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.908363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb" event={"ID":"593e110a-2a33-43e7-9395-cdcaefb8ca7a","Type":"ContainerStarted","Data":"39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682"}
Jul 31 21:43:24.909927 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.909910    2568 generic.go:356] "Generic (PLEG): container finished" podID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerID="b99efb96c5eec59963d34ac42dffc1c40fa4c32dd34da9717e06339dddf7a7c2" exitCode=0
Jul 31 21:43:24.910307 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.909992    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8" event={"ID":"2b9700da-f36b-419f-a21c-55daaeb80c1b","Type":"ContainerDied","Data":"b99efb96c5eec59963d34ac42dffc1c40fa4c32dd34da9717e06339dddf7a7c2"}
Jul 31 21:43:24.910511 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.910340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8" event={"ID":"2b9700da-f36b-419f-a21c-55daaeb80c1b","Type":"ContainerStarted","Data":"14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81"}
Jul 31 21:43:24.914181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.913918    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c54d847-4dc5-4589-992d-2fc69958336f" containerID="734120cec2c4d7db664a3a2638d141c1b345e1b8f996043be7adfbc87c985b87" exitCode=0
Jul 31 21:43:24.914181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.913966    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7" event={"ID":"9c54d847-4dc5-4589-992d-2fc69958336f","Type":"ContainerDied","Data":"734120cec2c4d7db664a3a2638d141c1b345e1b8f996043be7adfbc87c985b87"}
Jul 31 21:43:24.914181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:24.914027    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7" event={"ID":"9c54d847-4dc5-4589-992d-2fc69958336f","Type":"ContainerStarted","Data":"1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4"}
Jul 31 21:43:25.922416 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:25.922388    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerID="795167889b385b791f88e59b8b70675b9afb68de7928f5bfe7484657370d669e" exitCode=0
Jul 31 21:43:25.922689 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:25.922454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws" event={"ID":"c8000833-05ba-4c1b-8ccd-c867d2ec328b","Type":"ContainerDied","Data":"795167889b385b791f88e59b8b70675b9afb68de7928f5bfe7484657370d669e"}
Jul 31 21:43:26.929114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.929079    2568 generic.go:356] "Generic (PLEG): container finished" podID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerID="8c935606711b188363a7c9b6d6a4d50ed25b15f888d6d1639e356ce5d374d419" exitCode=0
Jul 31 21:43:26.929444 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.929158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8" event={"ID":"2b9700da-f36b-419f-a21c-55daaeb80c1b","Type":"ContainerDied","Data":"8c935606711b188363a7c9b6d6a4d50ed25b15f888d6d1639e356ce5d374d419"}
Jul 31 21:43:26.931071 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.931049    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c54d847-4dc5-4589-992d-2fc69958336f" containerID="749c5c4ed58330d8bee9da8ce4447a4fd2f0db72cd997b8f209951536925d961" exitCode=0
Jul 31 21:43:26.931173 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.931148    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7" event={"ID":"9c54d847-4dc5-4589-992d-2fc69958336f","Type":"ContainerDied","Data":"749c5c4ed58330d8bee9da8ce4447a4fd2f0db72cd997b8f209951536925d961"}
Jul 31 21:43:26.933518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.933498    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerID="fb87e9dd673c6df17abc6463d115199dbe4d1e6d26f637db6228726ef53e39a6" exitCode=0
Jul 31 21:43:26.933607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.933579    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws" event={"ID":"c8000833-05ba-4c1b-8ccd-c867d2ec328b","Type":"ContainerDied","Data":"fb87e9dd673c6df17abc6463d115199dbe4d1e6d26f637db6228726ef53e39a6"}
Jul 31 21:43:26.935412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.935393    2568 generic.go:356] "Generic (PLEG): container finished" podID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerID="5bd7c4c915f0cd87cae1753b263ef3416fb50a1fb024b117f9294d33be24d261" exitCode=0
Jul 31 21:43:26.935492 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:26.935444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb" event={"ID":"593e110a-2a33-43e7-9395-cdcaefb8ca7a","Type":"ContainerDied","Data":"5bd7c4c915f0cd87cae1753b263ef3416fb50a1fb024b117f9294d33be24d261"}
Jul 31 21:43:27.943789 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.943751    2568 generic.go:356] "Generic (PLEG): container finished" podID="9c54d847-4dc5-4589-992d-2fc69958336f" containerID="f2594f6143689fd98ecc75d32a5848377aeea51ffd8011d3eb85294382851eff" exitCode=0
Jul 31 21:43:27.944200 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.943859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7" event={"ID":"9c54d847-4dc5-4589-992d-2fc69958336f","Type":"ContainerDied","Data":"f2594f6143689fd98ecc75d32a5848377aeea51ffd8011d3eb85294382851eff"}
Jul 31 21:43:27.946319 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.946293    2568 generic.go:356] "Generic (PLEG): container finished" podID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerID="b5db0abde6feabad73aefbff9069c107096a86d1d9da770aa74da2b249e59827" exitCode=0
Jul 31 21:43:27.946454 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.946375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb" event={"ID":"593e110a-2a33-43e7-9395-cdcaefb8ca7a","Type":"ContainerDied","Data":"b5db0abde6feabad73aefbff9069c107096a86d1d9da770aa74da2b249e59827"}
Jul 31 21:43:27.949040 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.949017    2568 generic.go:356] "Generic (PLEG): container finished" podID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerID="f476492812b8eda7aa54234ef6b8b736daae41db16ea2ebcbe376981a05fb545" exitCode=0
Jul 31 21:43:27.949157 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:27.949098    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8" event={"ID":"2b9700da-f36b-419f-a21c-55daaeb80c1b","Type":"ContainerDied","Data":"f476492812b8eda7aa54234ef6b8b736daae41db16ea2ebcbe376981a05fb545"}
Jul 31 21:43:28.088222 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.088199    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:28.108467 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.108443    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62t2s\" (UniqueName: \"kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s\") pod \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") "
Jul 31 21:43:28.108579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.108491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle\") pod \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") "
Jul 31 21:43:28.108579 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.108548    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util\") pod \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\" (UID: \"c8000833-05ba-4c1b-8ccd-c867d2ec328b\") "
Jul 31 21:43:28.109133 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.109111    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle" (OuterVolumeSpecName: "bundle") pod "c8000833-05ba-4c1b-8ccd-c867d2ec328b" (UID: "c8000833-05ba-4c1b-8ccd-c867d2ec328b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:28.110307 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.110286    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s" (OuterVolumeSpecName: "kube-api-access-62t2s") pod "c8000833-05ba-4c1b-8ccd-c867d2ec328b" (UID: "c8000833-05ba-4c1b-8ccd-c867d2ec328b"). InnerVolumeSpecName "kube-api-access-62t2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:43:28.114087 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.114063    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util" (OuterVolumeSpecName: "util") pod "c8000833-05ba-4c1b-8ccd-c867d2ec328b" (UID: "c8000833-05ba-4c1b-8ccd-c867d2ec328b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:28.209063 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.209034    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62t2s\" (UniqueName: \"kubernetes.io/projected/c8000833-05ba-4c1b-8ccd-c867d2ec328b-kube-api-access-62t2s\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:28.209063 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.209062    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:28.209181 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.209076    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8000833-05ba-4c1b-8ccd-c867d2ec328b-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:28.958003 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.957969    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws"
Jul 31 21:43:28.958406 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.957996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4hws" event={"ID":"c8000833-05ba-4c1b-8ccd-c867d2ec328b","Type":"ContainerDied","Data":"e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e"}
Jul 31 21:43:28.958406 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:28.958057    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e72cbcb74adb1cc7e205002fcf9bc2fcb7e3d0e0bc912a159b8939ff2898cc7e"
Jul 31 21:43:29.114859 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.114835    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:29.121863 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.121843    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:29.155024 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.155003    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:29.216772 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216748    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util\") pod \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") "
Jul 31 21:43:29.216900 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtfqw\" (UniqueName: \"kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw\") pod \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") "
Jul 31 21:43:29.216900 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle\") pod \"2b9700da-f36b-419f-a21c-55daaeb80c1b\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") "
Jul 31 21:43:29.216900 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util\") pod \"9c54d847-4dc5-4589-992d-2fc69958336f\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") "
Jul 31 21:43:29.216900 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216862    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6tjv\" (UniqueName: \"kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv\") pod \"2b9700da-f36b-419f-a21c-55daaeb80c1b\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") "
Jul 31 21:43:29.217086 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.216933    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle\") pod \"9c54d847-4dc5-4589-992d-2fc69958336f\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") "
Jul 31 21:43:29.217086 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217015    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xffgg\" (UniqueName: \"kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg\") pod \"9c54d847-4dc5-4589-992d-2fc69958336f\" (UID: \"9c54d847-4dc5-4589-992d-2fc69958336f\") "
Jul 31 21:43:29.217086 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217078    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util\") pod \"2b9700da-f36b-419f-a21c-55daaeb80c1b\" (UID: \"2b9700da-f36b-419f-a21c-55daaeb80c1b\") "
Jul 31 21:43:29.217228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217104    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle\") pod \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\" (UID: \"593e110a-2a33-43e7-9395-cdcaefb8ca7a\") "
Jul 31 21:43:29.218005 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217432    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle" (OuterVolumeSpecName: "bundle") pod "2b9700da-f36b-419f-a21c-55daaeb80c1b" (UID: "2b9700da-f36b-419f-a21c-55daaeb80c1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.218005 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217938    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle" (OuterVolumeSpecName: "bundle") pod "593e110a-2a33-43e7-9395-cdcaefb8ca7a" (UID: "593e110a-2a33-43e7-9395-cdcaefb8ca7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.218005 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.217957    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle" (OuterVolumeSpecName: "bundle") pod "9c54d847-4dc5-4589-992d-2fc69958336f" (UID: "9c54d847-4dc5-4589-992d-2fc69958336f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.219132 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.219109    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw" (OuterVolumeSpecName: "kube-api-access-rtfqw") pod "593e110a-2a33-43e7-9395-cdcaefb8ca7a" (UID: "593e110a-2a33-43e7-9395-cdcaefb8ca7a"). InnerVolumeSpecName "kube-api-access-rtfqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:43:29.219346 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.219329    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv" (OuterVolumeSpecName: "kube-api-access-n6tjv") pod "2b9700da-f36b-419f-a21c-55daaeb80c1b" (UID: "2b9700da-f36b-419f-a21c-55daaeb80c1b"). InnerVolumeSpecName "kube-api-access-n6tjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:43:29.219482 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.219421    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg" (OuterVolumeSpecName: "kube-api-access-xffgg") pod "9c54d847-4dc5-4589-992d-2fc69958336f" (UID: "9c54d847-4dc5-4589-992d-2fc69958336f"). InnerVolumeSpecName "kube-api-access-xffgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:43:29.223065 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.223040    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util" (OuterVolumeSpecName: "util") pod "9c54d847-4dc5-4589-992d-2fc69958336f" (UID: "9c54d847-4dc5-4589-992d-2fc69958336f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.224927 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.224904    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util" (OuterVolumeSpecName: "util") pod "593e110a-2a33-43e7-9395-cdcaefb8ca7a" (UID: "593e110a-2a33-43e7-9395-cdcaefb8ca7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.226022 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.226005    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util" (OuterVolumeSpecName: "util") pod "2b9700da-f36b-419f-a21c-55daaeb80c1b" (UID: "2b9700da-f36b-419f-a21c-55daaeb80c1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318478    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318507    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xffgg\" (UniqueName: \"kubernetes.io/projected/9c54d847-4dc5-4589-992d-2fc69958336f-kube-api-access-xffgg\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318517    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318525    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318533    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/593e110a-2a33-43e7-9395-cdcaefb8ca7a-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318541    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtfqw\" (UniqueName: \"kubernetes.io/projected/593e110a-2a33-43e7-9395-cdcaefb8ca7a-kube-api-access-rtfqw\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318549    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b9700da-f36b-419f-a21c-55daaeb80c1b-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318786 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318556    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c54d847-4dc5-4589-992d-2fc69958336f-util\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.318786 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.318565    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6tjv\" (UniqueName: \"kubernetes.io/projected/2b9700da-f36b-419f-a21c-55daaeb80c1b-kube-api-access-n6tjv\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:29.888314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.888271    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-557c65f767-4cpf7" podUID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" containerName="console" containerID="cri-o://7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3" gracePeriod=15
Jul 31 21:43:29.965851 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.965796    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb"
Jul 31 21:43:29.966315 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.965840    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0wlzhb" event={"ID":"593e110a-2a33-43e7-9395-cdcaefb8ca7a","Type":"ContainerDied","Data":"39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682"}
Jul 31 21:43:29.966315 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.965897    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39735a808e7aab04d575c9a16f3215674c288e465ad7955c728281ae3756d682"
Jul 31 21:43:29.968158 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.968140    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8"
Jul 31 21:43:29.968256 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.968158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cpccj8" event={"ID":"2b9700da-f36b-419f-a21c-55daaeb80c1b","Type":"ContainerDied","Data":"14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81"}
Jul 31 21:43:29.968256 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.968205    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14badc71334e4a0863d51c984f98da22e83e2c7222ee8f4e64855f2c455a7a81"
Jul 31 21:43:29.970465 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.970446    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7"
Jul 31 21:43:29.970580 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.970421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb52xv7" event={"ID":"9c54d847-4dc5-4589-992d-2fc69958336f","Type":"ContainerDied","Data":"1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4"}
Jul 31 21:43:29.970645 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:29.970578    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d8d49bfb0a29391bad62a00b701469eb8626bed88f3cc976825145f713bc6f4"
Jul 31 21:43:30.132289 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.132268    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:43:30.226810 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.226756    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wngss\" (UniqueName: \"kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.226920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.226809    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.226969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.226936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.226969 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.226959    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.227064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.226991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.227064 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.227155 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227076    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config\") pod \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\" (UID: \"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33\") "
Jul 31 21:43:30.227279 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227238    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:43:30.227365 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227308    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-oauth-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.227365 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227351    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca" (OuterVolumeSpecName: "service-ca") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:43:30.227499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227420    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:43:30.227551 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.227514    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config" (OuterVolumeSpecName: "console-config") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:43:30.229060 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.229032    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss" (OuterVolumeSpecName: "kube-api-access-wngss") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "kube-api-access-wngss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:43:30.229142 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.229038    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:43:30.229142 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.229096    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" (UID: "00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:43:30.273928 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.273885    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:30.327682 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327661    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-oauth-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.327682 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327680    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-serving-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.327798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327693    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-trusted-ca-bundle\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.327798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327706    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.327798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327714    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-console-config\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.327798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.327723    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wngss\" (UniqueName: \"kubernetes.io/projected/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33-kube-api-access-wngss\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:43:30.352453 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.352422    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:30.984995 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.984964    2568 generic.go:356] "Generic (PLEG): container finished" podID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" containerID="7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3" exitCode=0
Jul 31 21:43:30.985419 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.985024    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c65f767-4cpf7"
Jul 31 21:43:30.985419 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.985058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c65f767-4cpf7" event={"ID":"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33","Type":"ContainerDied","Data":"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"}
Jul 31 21:43:30.985419 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.985154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c65f767-4cpf7" event={"ID":"00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33","Type":"ContainerDied","Data":"1ef294ae60b517a8b8b0535fc9f4044b05b5213894493834d0368f9440cdf247"}
Jul 31 21:43:30.985419 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.985185    2568 scope.go:117] "RemoveContainer" containerID="7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"
Jul 31 21:43:30.995068 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.995046    2568 scope.go:117] "RemoveContainer" containerID="7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"
Jul 31 21:43:30.995385 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:43:30.995362    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3\": container with ID starting with 7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3 not found: ID does not exist" containerID="7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"
Jul 31 21:43:30.995433 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:30.995394    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3"} err="failed to get container status \"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3\": rpc error: code = NotFound desc = could not find container \"7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3\": container with ID starting with 7b5e81178bc5fd8e3799429860fa86038b173109db2bde4cd6e5fc73158849f3 not found: ID does not exist"
Jul 31 21:43:31.003889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:31.003864    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:43:31.008139 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:31.008117    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557c65f767-4cpf7"]
Jul 31 21:43:32.757732 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:32.757696    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" path="/var/lib/kubelet/pods/00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33/volumes"
Jul 31 21:43:34.575543 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:34.575511    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:37.424946 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:37.424909    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:39.036648 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:39.036617    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:39.148727 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:39.148693    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:39.782554 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:39.782516    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:40.178675 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:40.178601    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:40.462873 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:40.462777    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:41.256704 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:41.256675    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:43.408081 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.407996    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"]
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408394    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="pull"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408405    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="pull"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408414    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="util"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408420    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="util"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408430    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="util"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408436    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="util"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408443    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="util"
Jul 31 21:43:43.408447 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408449    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="util"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408457    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="util"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408463    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="util"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408474    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" containerName="console"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408479    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" containerName="console"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408487    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408492    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408502    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408507    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408514    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408518    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408525    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408529    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="pull"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408535    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408539    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408544    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408549    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408558    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408563    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408620    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00c0204b-e3e8-4c05-bd02-6b6c1d7d4e33" containerName="console"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408626    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="593e110a-2a33-43e7-9395-cdcaefb8ca7a" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408633    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9700da-f36b-419f-a21c-55daaeb80c1b" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408641    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c54d847-4dc5-4589-992d-2fc69958336f" containerName="extract"
Jul 31 21:43:43.408701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.408646    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8000833-05ba-4c1b-8ccd-c867d2ec328b" containerName="extract"
Jul 31 21:43:43.413392 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.413374    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.415654 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.415629    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7k9cd\""
Jul 31 21:43:43.416632 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.416616    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 21:43:43.416691 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.416643    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 21:43:43.429394 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.429366    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"]
Jul 31 21:43:43.535008 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.534979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbqw\" (UniqueName: \"kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.535134 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.535023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.558928 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.558906    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:43.635486 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.635459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbqw\" (UniqueName: \"kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.635591 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.635507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.635890 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.635874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.649768 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.649746    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbqw\" (UniqueName: \"kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw\") pod \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.724398 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.724343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:43.859058 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.859032    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"]
Jul 31 21:43:43.861916 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:43.861885    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa365ac_01fe_40e1_9641_99f87c4ec9bd.slice/crio-10b3c90d631012631d6f05fa7c25b361f205b0714fea5afa31e27916e8182601 WatchSource:0}: Error finding container 10b3c90d631012631d6f05fa7c25b361f205b0714fea5afa31e27916e8182601: Status 404 returned error can't find the container with id 10b3c90d631012631d6f05fa7c25b361f205b0714fea5afa31e27916e8182601
Jul 31 21:43:43.965685 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:43.965652    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:44.059657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:44.059625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6" event={"ID":"efa365ac-01fe-40e1-9641-99f87c4ec9bd","Type":"ContainerStarted","Data":"10b3c90d631012631d6f05fa7c25b361f205b0714fea5afa31e27916e8182601"}
Jul 31 21:43:45.047359 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:45.047328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:47.390273 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:47.390231    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:47.492945 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:47.492908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:49.092927 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:49.092882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6" event={"ID":"efa365ac-01fe-40e1-9641-99f87c4ec9bd","Type":"ContainerStarted","Data":"c8caa4b0eb9c02d03224cc0dad9131f10289d062d7245433f7829375c1aadf94"}
Jul 31 21:43:49.093353 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:49.092953    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:43:50.590936 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.590885    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:50.591853 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.591799    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6" podStartSLOduration=3.350302864 podStartE2EDuration="7.591782476s" totalImagesPullingTime="4.241479612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:43:49.118795683 +0000 UTC m=+464.907129255" watchObservedRunningTime="2026-07-31 21:43:50.591782476 +0000 UTC m=+466.380116066"
Jul 31 21:43:50.592669 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.592652    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"]
Jul 31 21:43:50.596193 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.596173    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.598356 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.598333    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 31 21:43:50.598356 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.598347    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 31 21:43:50.598522 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.598351    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t5g22\""
Jul 31 21:43:50.604599 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.604577    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"]
Jul 31 21:43:50.700515 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.700488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.700631 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.700554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.700631 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.700615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvth\" (UniqueName: \"kubernetes.io/projected/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-kube-api-access-4cvth\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.781999 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.781955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:50.801490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.801469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.801587 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.801499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvth\" (UniqueName: \"kubernetes.io/projected/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-kube-api-access-4cvth\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.801587 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.801527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.802109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.802089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.803800 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.803783    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.810578 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.810556    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvth\" (UniqueName: \"kubernetes.io/projected/8d8a1234-c6e7-4c18-b4b9-c1567f9ae000-kube-api-access-4cvth\") pod \"kuadrant-console-plugin-598f86468b-zt9b2\" (UID: \"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.906277 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.906229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"
Jul 31 21:43:50.954621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:50.954573    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:51.043830 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:51.043764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2"]
Jul 31 21:43:51.046013 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:43:51.045988    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d8a1234_c6e7_4c18_b4b9_c1567f9ae000.slice/crio-b98a61c91b6748d9b20861674a99e14831f0f5b19da1d1ba34481e7eeee0ec40 WatchSource:0}: Error finding container b98a61c91b6748d9b20861674a99e14831f0f5b19da1d1ba34481e7eeee0ec40: Status 404 returned error can't find the container with id b98a61c91b6748d9b20861674a99e14831f0f5b19da1d1ba34481e7eeee0ec40
Jul 31 21:43:51.048654 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:51.048616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:51.104793 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:51.104767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2" event={"ID":"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000","Type":"ContainerStarted","Data":"b98a61c91b6748d9b20861674a99e14831f0f5b19da1d1ba34481e7eeee0ec40"}
Jul 31 21:43:55.040278 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:55.040230    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:55.140762 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:55.140716    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:55.308900 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:55.308779    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:43:57.141267 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:57.141230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2" event={"ID":"8d8a1234-c6e7-4c18-b4b9-c1567f9ae000","Type":"ContainerStarted","Data":"0592375c728ce35586d27ad44ce217eb0e7c4df765e9b275fab6123094fa3f28"}
Jul 31 21:43:57.162080 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:43:57.162032    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zt9b2" podStartSLOduration=2.061385604 podStartE2EDuration="7.16201415s" totalImagesPullingTime="5.100628546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:43:57.161202718 +0000 UTC m=+472.949536291" watchObservedRunningTime="2026-07-31 21:43:57.16201415 +0000 UTC m=+472.950347723"
Jul 31 21:44:00.100360 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:00.100323    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:01.678698 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.678660    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"]
Jul 31 21:44:01.683735 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.683716    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.702343 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.702309    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"]
Jul 31 21:44:01.797389 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.797365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59q57\" (UniqueName: \"kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.797500 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.797405    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.898714 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.898686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59q57\" (UniqueName: \"kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.898874 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.898846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.899333 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.899309    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.909995 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.909964    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59q57\" (UniqueName: \"kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57\") pod \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.936290 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.936237    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"]
Jul 31 21:44:01.936428 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.936405    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" containerName="manager" containerID="cri-o://c8caa4b0eb9c02d03224cc0dad9131f10289d062d7245433f7829375c1aadf94" gracePeriod=2
Jul 31 21:44:01.951373 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.951346    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"]
Jul 31 21:44:01.964168 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:01.964135    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"efa365ac-01fe-40e1-9641-99f87c4ec9bd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-n85q6\": pods \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:01.969995 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.969948    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"]
Jul 31 21:44:01.970491 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.970472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:01.972983 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.972960    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:01.973521 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.973503    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" containerName="manager"
Jul 31 21:44:01.973521 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.973523    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" containerName="manager"
Jul 31 21:44:01.973674 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.973644    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" containerName="manager"
Jul 31 21:44:01.977113 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.977093    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"]
Jul 31 21:44:01.977201 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.977189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:01.997437 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:01.997329    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:02.009310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.009286    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:02.012936 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.012919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.021505 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:02.021469    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:02.024185 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:02.024142    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:02.027075 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.027054    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:02.101350 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.101322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrgwn\" (UniqueName: \"kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.101499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.101371    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.101499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.101419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4kv\" (UniqueName: \"kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.101499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.101445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.176066 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.176032    2568 generic.go:356] "Generic (PLEG): container finished" podID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" containerID="c8caa4b0eb9c02d03224cc0dad9131f10289d062d7245433f7829375c1aadf94" exitCode=0
Jul 31 21:44:02.176178 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.176117    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10b3c90d631012631d6f05fa7c25b361f205b0714fea5afa31e27916e8182601"
Jul 31 21:44:02.180399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.180381    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:02.182407 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:02.182388    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n85q6\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:02.202926 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.202878    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrgwn\" (UniqueName: \"kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.202926 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.202920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.203057 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.202955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4kv\" (UniqueName: \"kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.203057 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.202984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.203327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.203307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.203386 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.203330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.217599 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.217569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4kv\" (UniqueName: \"kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv\") pod \"kuadrant-operator-controller-manager-58fc56757c-c7b8m\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.218712 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.218692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrgwn\" (UniqueName: \"kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn\") pod \"kuadrant-operator-controller-manager-6bd956ccf-mtccn\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.303934 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.303910    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume\") pod \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") "
Jul 31 21:44:02.304029 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.304018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmbqw\" (UniqueName: \"kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw\") pod \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\" (UID: \"efa365ac-01fe-40e1-9641-99f87c4ec9bd\") "
Jul 31 21:44:02.304439 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.304412    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "efa365ac-01fe-40e1-9641-99f87c4ec9bd" (UID: "efa365ac-01fe-40e1-9641-99f87c4ec9bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:44:02.305797 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.305780    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw" (OuterVolumeSpecName: "kube-api-access-mmbqw") pod "efa365ac-01fe-40e1-9641-99f87c4ec9bd" (UID: "efa365ac-01fe-40e1-9641-99f87c4ec9bd"). InnerVolumeSpecName "kube-api-access-mmbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:02.310930 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.310913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:02.323316 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.323299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:02.405754 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.405730    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmbqw\" (UniqueName: \"kubernetes.io/projected/efa365ac-01fe-40e1-9641-99f87c4ec9bd-kube-api-access-mmbqw\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:02.405862 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.405761    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/efa365ac-01fe-40e1-9641-99f87c4ec9bd-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:02.460235 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.460166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:02.463699 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:44:02.463670    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd12c32d_37be_4d99_af76_abdd9ddb3c86.slice/crio-6fb8ca6abed7e3e80f80640eb9fccf4cfdc37564252835f3cd15bfa090da840b WatchSource:0}: Error finding container 6fb8ca6abed7e3e80f80640eb9fccf4cfdc37564252835f3cd15bfa090da840b: Status 404 returned error can't find the container with id 6fb8ca6abed7e3e80f80640eb9fccf4cfdc37564252835f3cd15bfa090da840b
Jul 31 21:44:02.475067 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.475045    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:02.476588 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:44:02.476566    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8283fb5_9baf_4d4f_9d3f_62819b547cae.slice/crio-08b0ecc4c31fc98a89b84f1691941fe7f4bb3f7db54c6f4dfee941186db00b32 WatchSource:0}: Error finding container 08b0ecc4c31fc98a89b84f1691941fe7f4bb3f7db54c6f4dfee941186db00b32: Status 404 returned error can't find the container with id 08b0ecc4c31fc98a89b84f1691941fe7f4bb3f7db54c6f4dfee941186db00b32
Jul 31 21:44:02.756823 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:02.756789    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa365ac-01fe-40e1-9641-99f87c4ec9bd" path="/var/lib/kubelet/pods/efa365ac-01fe-40e1-9641-99f87c4ec9bd/volumes"
Jul 31 21:44:03.183399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.183319    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" event={"ID":"c8283fb5-9baf-4d4f-9d3f-62819b547cae","Type":"ContainerStarted","Data":"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"}
Jul 31 21:44:03.183399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.183372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" event={"ID":"c8283fb5-9baf-4d4f-9d3f-62819b547cae","Type":"ContainerStarted","Data":"08b0ecc4c31fc98a89b84f1691941fe7f4bb3f7db54c6f4dfee941186db00b32"}
Jul 31 21:44:03.183608 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.183480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:03.185013 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.184990    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" event={"ID":"cd12c32d-37be-4d99-af76-abdd9ddb3c86","Type":"ContainerStarted","Data":"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"}
Jul 31 21:44:03.185129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.185026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" event={"ID":"cd12c32d-37be-4d99-af76-abdd9ddb3c86","Type":"ContainerStarted","Data":"6fb8ca6abed7e3e80f80640eb9fccf4cfdc37564252835f3cd15bfa090da840b"}
Jul 31 21:44:03.185129 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.185093    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:03.185198 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.185133    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n85q6"
Jul 31 21:44:03.214731 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.214687    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" podStartSLOduration=2.214674367 podStartE2EDuration="2.214674367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:03.211160572 +0000 UTC m=+478.999494142" watchObservedRunningTime="2026-07-31 21:44:03.214674367 +0000 UTC m=+479.003007937"
Jul 31 21:44:03.251513 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.251478    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" podStartSLOduration=2.251466857 podStartE2EDuration="2.251466857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:03.244891307 +0000 UTC m=+479.033224878" watchObservedRunningTime="2026-07-31 21:44:03.251466857 +0000 UTC m=+479.039800429"
Jul 31 21:44:03.917576 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:03.917547    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:04.011151 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:04.011122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:04.525918 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:04.525878    2568 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-cknc7_kuadrant-system_979abdbb-120a-48e1-be91-f712445e5860_0(67ef24912f532baf690058af1b1cbe5b6675f3512971ccbdd819c1d6f3f2c314): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-cknc7 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 31 21:44:04.526030 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:04.525940    2568 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-cknc7_kuadrant-system_979abdbb-120a-48e1-be91-f712445e5860_0(67ef24912f532baf690058af1b1cbe5b6675f3512971ccbdd819c1d6f3f2c314): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-cknc7 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:05.196372 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.196343    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:05.199337 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:05.199300    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="979abdbb-120a-48e1-be91-f712445e5860" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:05.204338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.204318    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:05.206041 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:05.206018    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="979abdbb-120a-48e1-be91-f712445e5860" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:05.326460 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.326436    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59q57\" (UniqueName: \"kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57\") pod \"979abdbb-120a-48e1-be91-f712445e5860\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") "
Jul 31 21:44:05.326641 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.326504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume\") pod \"979abdbb-120a-48e1-be91-f712445e5860\" (UID: \"979abdbb-120a-48e1-be91-f712445e5860\") "
Jul 31 21:44:05.326791 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.326763    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "979abdbb-120a-48e1-be91-f712445e5860" (UID: "979abdbb-120a-48e1-be91-f712445e5860"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:44:05.328245 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.328221    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57" (OuterVolumeSpecName: "kube-api-access-59q57") pod "979abdbb-120a-48e1-be91-f712445e5860" (UID: "979abdbb-120a-48e1-be91-f712445e5860"). InnerVolumeSpecName "kube-api-access-59q57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:05.427425 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.427402    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/979abdbb-120a-48e1-be91-f712445e5860-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:05.427425 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:05.427426    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59q57\" (UniqueName: \"kubernetes.io/projected/979abdbb-120a-48e1-be91-f712445e5860-kube-api-access-59q57\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:06.202079 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:06.202049    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:06.207317 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:06.207285    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="979abdbb-120a-48e1-be91-f712445e5860" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:06.210089 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:06.210060    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-cknc7\" is forbidden: User \"system:node:ip-10-0-134-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-210.ec2.internal' and this object" podUID="979abdbb-120a-48e1-be91-f712445e5860" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-cknc7"
Jul 31 21:44:06.489035 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:06.489006    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:06.606653 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:06.606627    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:06.756799 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:06.756741    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979abdbb-120a-48e1-be91-f712445e5860" path="/var/lib/kubelet/pods/979abdbb-120a-48e1-be91-f712445e5860/volumes"
Jul 31 21:44:09.672756 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:09.672722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:09.788352 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:09.788319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:12.690792 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:12.690751    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.134483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.134448    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.193353 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.193324    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:14.193494 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.193385    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:14.222935 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.222906    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.292403 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.292367    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:14.292567 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.292541    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" podUID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" containerName="manager" containerID="cri-o://763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b" gracePeriod=10
Jul 31 21:44:14.327549 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.327517    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.426747 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.426714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.526933 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.526906    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.531114 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.531094    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:14.636163 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.636139    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:14.702657 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.702600    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:44:14.703020 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.703008    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" containerName="manager"
Jul 31 21:44:14.703068 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.703022    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" containerName="manager"
Jul 31 21:44:14.703124 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.703115    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" containerName="manager"
Jul 31 21:44:14.704491 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.704472    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume\") pod \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") "
Jul 31 21:44:14.704541 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.704510    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn4kv\" (UniqueName: \"kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv\") pod \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\" (UID: \"cd12c32d-37be-4d99-af76-abdd9ddb3c86\") "
Jul 31 21:44:14.704889 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.704869    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd12c32d-37be-4d99-af76-abdd9ddb3c86" (UID: "cd12c32d-37be-4d99-af76-abdd9ddb3c86"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:44:14.706244 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.706230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.706537 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.706518    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv" (OuterVolumeSpecName: "kube-api-access-cn4kv") pod "cd12c32d-37be-4d99-af76-abdd9ddb3c86" (UID: "cd12c32d-37be-4d99-af76-abdd9ddb3c86"). InnerVolumeSpecName "kube-api-access-cn4kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:14.730492 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.730465    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:44:14.805621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.805588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgr52\" (UniqueName: \"kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.805757 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.805715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.805836 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.805803    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd12c32d-37be-4d99-af76-abdd9ddb3c86-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:14.805907 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.805841    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn4kv\" (UniqueName: \"kubernetes.io/projected/cd12c32d-37be-4d99-af76-abdd9ddb3c86-kube-api-access-cn4kv\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:14.906562 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.906535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgr52\" (UniqueName: \"kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.906687 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.906600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.906933 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.906916    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:14.919960 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:14.919940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgr52\" (UniqueName: \"kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52\") pod \"kuadrant-operator-controller-manager-68cf589589-7sr9x\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:15.024571 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.024548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:15.161237 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.161208    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:44:15.163009 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:44:15.162981    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cef8a0_6dd3_4a05_b1e4_db4549fa49be.slice/crio-d820b6a8f6a9783b22b7c1b4206f8fffd3af17e016dc4e9c907a04f809a8922f WatchSource:0}: Error finding container d820b6a8f6a9783b22b7c1b4206f8fffd3af17e016dc4e9c907a04f809a8922f: Status 404 returned error can't find the container with id d820b6a8f6a9783b22b7c1b4206f8fffd3af17e016dc4e9c907a04f809a8922f
Jul 31 21:44:15.258578 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.258548    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" event={"ID":"57cef8a0-6dd3-4a05-b1e4-db4549fa49be","Type":"ContainerStarted","Data":"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"}
Jul 31 21:44:15.258687 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.258599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" event={"ID":"57cef8a0-6dd3-4a05-b1e4-db4549fa49be","Type":"ContainerStarted","Data":"d820b6a8f6a9783b22b7c1b4206f8fffd3af17e016dc4e9c907a04f809a8922f"}
Jul 31 21:44:15.258687 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.258667    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:15.259917 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.259895    2568 generic.go:356] "Generic (PLEG): container finished" podID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" containerID="763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b" exitCode=0
Jul 31 21:44:15.260021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.259941    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"
Jul 31 21:44:15.260021 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.259976    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" event={"ID":"cd12c32d-37be-4d99-af76-abdd9ddb3c86","Type":"ContainerDied","Data":"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"}
Jul 31 21:44:15.260102 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.260021    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m" event={"ID":"cd12c32d-37be-4d99-af76-abdd9ddb3c86","Type":"ContainerDied","Data":"6fb8ca6abed7e3e80f80640eb9fccf4cfdc37564252835f3cd15bfa090da840b"}
Jul 31 21:44:15.260102 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.260042    2568 scope.go:117] "RemoveContainer" containerID="763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"
Jul 31 21:44:15.268261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.268243    2568 scope.go:117] "RemoveContainer" containerID="763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"
Jul 31 21:44:15.268495 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:15.268474    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b\": container with ID starting with 763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b not found: ID does not exist" containerID="763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"
Jul 31 21:44:15.268566 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.268502    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b"} err="failed to get container status \"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b\": rpc error: code = NotFound desc = could not find container \"763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b\": container with ID starting with 763926c401f8ca9351bd6280953017063d8f6dfadf6493567fd756cc8cf8170b not found: ID does not exist"
Jul 31 21:44:15.287391 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.287311    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" podStartSLOduration=1.287294184 podStartE2EDuration="1.287294184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:15.28608677 +0000 UTC m=+491.074420341" watchObservedRunningTime="2026-07-31 21:44:15.287294184 +0000 UTC m=+491.075627762"
Jul 31 21:44:15.313294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.313271    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:15.321761 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:15.321736    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-c7b8m"]
Jul 31 21:44:16.756626 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:16.756588    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd12c32d-37be-4d99-af76-abdd9ddb3c86" path="/var/lib/kubelet/pods/cd12c32d-37be-4d99-af76-abdd9ddb3c86/volumes"
Jul 31 21:44:23.008796 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:23.008760    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:23.106409 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:23.106379    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:26.269946 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.269906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:44:26.336132 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.336098    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:26.336349 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.336320    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" podUID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" containerName="manager" containerID="cri-o://7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3" gracePeriod=10
Jul 31 21:44:26.603949 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.603927    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:26.697595 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.697567    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume\") pod \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") "
Jul 31 21:44:26.697729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.697713    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrgwn\" (UniqueName: \"kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn\") pod \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\" (UID: \"c8283fb5-9baf-4d4f-9d3f-62819b547cae\") "
Jul 31 21:44:26.697907 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.697886    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8283fb5-9baf-4d4f-9d3f-62819b547cae" (UID: "c8283fb5-9baf-4d4f-9d3f-62819b547cae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:44:26.698063 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.698042    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8283fb5-9baf-4d4f-9d3f-62819b547cae-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:26.699590 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.699568    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn" (OuterVolumeSpecName: "kube-api-access-rrgwn") pod "c8283fb5-9baf-4d4f-9d3f-62819b547cae" (UID: "c8283fb5-9baf-4d4f-9d3f-62819b547cae"). InnerVolumeSpecName "kube-api-access-rrgwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:26.798595 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:26.798573    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrgwn\" (UniqueName: \"kubernetes.io/projected/c8283fb5-9baf-4d4f-9d3f-62819b547cae-kube-api-access-rrgwn\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:27.335384 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.335354    2568 generic.go:356] "Generic (PLEG): container finished" podID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" containerID="7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3" exitCode=0
Jul 31 21:44:27.335719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.335406    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"
Jul 31 21:44:27.335719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.335450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" event={"ID":"c8283fb5-9baf-4d4f-9d3f-62819b547cae","Type":"ContainerDied","Data":"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"}
Jul 31 21:44:27.335719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.335517    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn" event={"ID":"c8283fb5-9baf-4d4f-9d3f-62819b547cae","Type":"ContainerDied","Data":"08b0ecc4c31fc98a89b84f1691941fe7f4bb3f7db54c6f4dfee941186db00b32"}
Jul 31 21:44:27.335719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.335549    2568 scope.go:117] "RemoveContainer" containerID="7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"
Jul 31 21:44:27.348441 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.348421    2568 scope.go:117] "RemoveContainer" containerID="7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"
Jul 31 21:44:27.348769 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:27.348749    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3\": container with ID starting with 7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3 not found: ID does not exist" containerID="7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"
Jul 31 21:44:27.348837 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.348777    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3"} err="failed to get container status \"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3\": rpc error: code = NotFound desc = could not find container \"7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3\": container with ID starting with 7efa61e85b8e25bed58bab0332954a8a8297c4d4d144bbc0f90679e37b44f4b3 not found: ID does not exist"
Jul 31 21:44:27.358627 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.358602    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:27.364284 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:27.364260    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-mtccn"]
Jul 31 21:44:28.756939 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:28.756903    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" path="/var/lib/kubelet/pods/c8283fb5-9baf-4d4f-9d3f-62819b547cae/volumes"
Jul 31 21:44:30.834310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.834276    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"]
Jul 31 21:44:30.834694 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.834681    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" containerName="manager"
Jul 31 21:44:30.834694 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.834696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" containerName="manager"
Jul 31 21:44:30.834800 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.834761    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8283fb5-9baf-4d4f-9d3f-62819b547cae" containerName="manager"
Jul 31 21:44:30.844805 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.844771    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:30.855499 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.855478    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"]
Jul 31 21:44:30.855617 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.855559    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.860028 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.860008    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x4jn9\""
Jul 31 21:44:30.931491 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931622 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931622 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931622 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931591    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931675    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931719 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdbb\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-kube-api-access-nkdbb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931807 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:30.931807 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:30.931751    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032517 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032644 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032873 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032873 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.032873 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.032735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdbb\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-kube-api-access-nkdbb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.033191 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.033168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.033314 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.033273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.033360 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.033339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.033399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.033355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.033399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.033385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.035012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.034989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.035132 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.035115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.041456 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.041434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdbb\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-kube-api-access-nkdbb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.041904 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.041886    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5ef3a95-8cf1-4f12-b52c-410f61fe53f0-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-qpl66\" (UID: \"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.168092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.168041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:31.174407 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.174381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:31.308327 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.308302    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"]
Jul 31 21:44:31.310438 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:44:31.310404    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ef3a95_8cf1_4f12_b52c_410f61fe53f0.slice/crio-f83901c815a5f515ffd439cd08130353e2d9a2362faf26a9d0fdb9a91f2fee92 WatchSource:0}: Error finding container f83901c815a5f515ffd439cd08130353e2d9a2362faf26a9d0fdb9a91f2fee92: Status 404 returned error can't find the container with id f83901c815a5f515ffd439cd08130353e2d9a2362faf26a9d0fdb9a91f2fee92
Jul 31 21:44:31.312604 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.312573    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:44:31.312698 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.312651    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:44:31.312759 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.312696    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:44:31.362193 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:31.362173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" event={"ID":"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0","Type":"ContainerStarted","Data":"f83901c815a5f515ffd439cd08130353e2d9a2362faf26a9d0fdb9a91f2fee92"}
Jul 31 21:44:32.370241 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:32.370195    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" event={"ID":"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0","Type":"ContainerStarted","Data":"e1c82e59106c058736822ce36418ae6f95363ed2ea554294955227e356fe7326"}
Jul 31 21:44:32.393658 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:32.393597    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podStartSLOduration=2.393582742 podStartE2EDuration="2.393582742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:32.390335238 +0000 UTC m=+508.178668814" watchObservedRunningTime="2026-07-31 21:44:32.393582742 +0000 UTC m=+508.181916313"
Jul 31 21:44:33.168584 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:33.168552    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:33.173292 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:33.173264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:33.376433 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:33.376404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:33.377303 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:33.377283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:44:44.786624 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:44.786580    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:44.886723 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:44.886690    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:44.966013 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:44.965984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:45.071200 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.071128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:45.145789 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.145757    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:45.809490 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.809450    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:45.814346 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.814324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:45.816925 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.816896    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wcjvp\""
Jul 31 21:44:45.821422 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.821398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:45.846493 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.846466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:45.858708 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.858688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wg8\" (UniqueName: \"kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8\") pod \"authorino-b54df94b4-nnpfx\" (UID: \"20d0cc8f-a177-452a-b310-4c1aa6ecef59\") " pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:45.957180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.957154    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:44:45.959294 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.959274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wg8\" (UniqueName: \"kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8\") pod \"authorino-b54df94b4-nnpfx\" (UID: \"20d0cc8f-a177-452a-b310-4c1aa6ecef59\") " pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:45.968751 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:45.968730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wg8\" (UniqueName: \"kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8\") pod \"authorino-b54df94b4-nnpfx\" (UID: \"20d0cc8f-a177-452a-b310-4c1aa6ecef59\") " pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:46.125786 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:46.125732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:46.265037 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:46.265005    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:46.265692 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:44:46.265665    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20d0cc8f_a177_452a_b310_4c1aa6ecef59.slice/crio-a1ff7df56acd3fbfab7a8187d0cf3bb53824b23ddd204ff8fcad7a8f0e9093df WatchSource:0}: Error finding container a1ff7df56acd3fbfab7a8187d0cf3bb53824b23ddd204ff8fcad7a8f0e9093df: Status 404 returned error can't find the container with id a1ff7df56acd3fbfab7a8187d0cf3bb53824b23ddd204ff8fcad7a8f0e9093df
Jul 31 21:44:46.453656 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:46.453589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nnpfx" event={"ID":"20d0cc8f-a177-452a-b310-4c1aa6ecef59","Type":"ContainerStarted","Data":"a1ff7df56acd3fbfab7a8187d0cf3bb53824b23ddd204ff8fcad7a8f0e9093df"}
Jul 31 21:44:48.471798 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:48.471759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nnpfx" event={"ID":"20d0cc8f-a177-452a-b310-4c1aa6ecef59","Type":"ContainerStarted","Data":"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"}
Jul 31 21:44:48.487994 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:48.487915    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-nnpfx" podStartSLOduration=1.523478206 podStartE2EDuration="3.487899518s" totalImagesPullingTime="1.964421312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:48.486783362 +0000 UTC m=+524.275116934" watchObservedRunningTime="2026-07-31 21:44:48.487899518 +0000 UTC m=+524.276233089"
Jul 31 21:44:49.605879 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:49.605838    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:50.483746 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:50.483701    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-nnpfx" podUID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" containerName="authorino" containerID="cri-o://a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b" gracePeriod=30
Jul 31 21:44:50.731397 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:50.731375    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:50.801498 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:50.801472    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2wg8\" (UniqueName: \"kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8\") pod \"20d0cc8f-a177-452a-b310-4c1aa6ecef59\" (UID: \"20d0cc8f-a177-452a-b310-4c1aa6ecef59\") "
Jul 31 21:44:50.803334 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:50.803307    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8" (OuterVolumeSpecName: "kube-api-access-c2wg8") pod "20d0cc8f-a177-452a-b310-4c1aa6ecef59" (UID: "20d0cc8f-a177-452a-b310-4c1aa6ecef59"). InnerVolumeSpecName "kube-api-access-c2wg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:50.903116 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:50.903086    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2wg8\" (UniqueName: \"kubernetes.io/projected/20d0cc8f-a177-452a-b310-4c1aa6ecef59-kube-api-access-c2wg8\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:44:51.491673 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.491633    2568 generic.go:356] "Generic (PLEG): container finished" podID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" containerID="a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b" exitCode=0
Jul 31 21:44:51.491885 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.491695    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-nnpfx"
Jul 31 21:44:51.491885 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.491721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nnpfx" event={"ID":"20d0cc8f-a177-452a-b310-4c1aa6ecef59","Type":"ContainerDied","Data":"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"}
Jul 31 21:44:51.491885 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.491766    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-nnpfx" event={"ID":"20d0cc8f-a177-452a-b310-4c1aa6ecef59","Type":"ContainerDied","Data":"a1ff7df56acd3fbfab7a8187d0cf3bb53824b23ddd204ff8fcad7a8f0e9093df"}
Jul 31 21:44:51.491885 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.491787    2568 scope.go:117] "RemoveContainer" containerID="a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"
Jul 31 21:44:51.502111 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.502089    2568 scope.go:117] "RemoveContainer" containerID="a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"
Jul 31 21:44:51.502381 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:44:51.502363    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b\": container with ID starting with a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b not found: ID does not exist" containerID="a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"
Jul 31 21:44:51.502441 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.502389    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b"} err="failed to get container status \"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b\": rpc error: code = NotFound desc = could not find container \"a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b\": container with ID starting with a4f2456bda0bae672b77639dd72e99cef03ca7e912a745a5567de0e0bdca668b not found: ID does not exist"
Jul 31 21:44:51.513640 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.513606    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:51.518301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:51.518276    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-nnpfx"]
Jul 31 21:44:52.757234 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:52.757199    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" path="/var/lib/kubelet/pods/20d0cc8f-a177-452a-b310-4c1aa6ecef59/volumes"
Jul 31 21:44:59.842729 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:44:59.842646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:00.011621 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.011585    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:00.304873 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.304834    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"]
Jul 31 21:45:00.305437 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.305421    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" containerName="authorino"
Jul 31 21:45:00.305487 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.305441    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" containerName="authorino"
Jul 31 21:45:00.305549 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.305538    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d0cc8f-a177-452a-b310-4c1aa6ecef59" containerName="authorino"
Jul 31 21:45:00.308623 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.308603    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.312301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.312284    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 21:45:00.312454 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.312436    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-x96v9\""
Jul 31 21:45:00.312937 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.312923    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 31 21:45:00.313007 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.312960    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 21:45:00.335854 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.335803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"]
Jul 31 21:45:00.382299 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.382276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c779840-5c45-4771-bd33-a5c498582e02-data\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.382410 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.382330    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n75mz\" (UniqueName: \"kubernetes.io/projected/5c779840-5c45-4771-bd33-a5c498582e02-kube-api-access-n75mz\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.390483 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.390460    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:00.483140 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.483111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c779840-5c45-4771-bd33-a5c498582e02-data\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.483285 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.483266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n75mz\" (UniqueName: \"kubernetes.io/projected/5c779840-5c45-4771-bd33-a5c498582e02-kube-api-access-n75mz\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.483520 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.483500    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5c779840-5c45-4771-bd33-a5c498582e02-data\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.499573 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.499554    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n75mz\" (UniqueName: \"kubernetes.io/projected/5c779840-5c45-4771-bd33-a5c498582e02-kube-api-access-n75mz\") pod \"postgres-69fb4594cf-ps7gn\" (UID: \"5c779840-5c45-4771-bd33-a5c498582e02\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.624950 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.624895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:00.764750 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:00.764716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"]
Jul 31 21:45:00.765947 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:45:00.765923    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c779840_5c45_4771_bd33_a5c498582e02.slice/crio-94577ebc115ee8dd3ddd14a1aa4db6452ee293bd58f15ece8fce0a4d030ac82f WatchSource:0}: Error finding container 94577ebc115ee8dd3ddd14a1aa4db6452ee293bd58f15ece8fce0a4d030ac82f: Status 404 returned error can't find the container with id 94577ebc115ee8dd3ddd14a1aa4db6452ee293bd58f15ece8fce0a4d030ac82f
Jul 31 21:45:01.556315 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:01.556239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn" event={"ID":"5c779840-5c45-4771-bd33-a5c498582e02","Type":"ContainerStarted","Data":"94577ebc115ee8dd3ddd14a1aa4db6452ee293bd58f15ece8fce0a4d030ac82f"}
Jul 31 21:45:05.238630 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:05.238605    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 31 21:45:05.453445 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:05.453403    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:05.585361 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:05.585287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn" event={"ID":"5c779840-5c45-4771-bd33-a5c498582e02","Type":"ContainerStarted","Data":"aa231a2011bc719a17f5c5a78a04a9e3ddc030b75b835efc28ae71fcf7baca1b"}
Jul 31 21:45:05.585500 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:05.585364    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:05.603340 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:05.603298    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn" podStartSLOduration=1.134262324 podStartE2EDuration="5.603283251s" totalImagesPullingTime="4.469020927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:45:05.601971569 +0000 UTC m=+541.390305138" watchObservedRunningTime="2026-07-31 21:45:05.603283251 +0000 UTC m=+541.391616823"
Jul 31 21:45:11.620300 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:11.620272    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ps7gn"
Jul 31 21:45:11.934017 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:11.933942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:12.033392 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.033364    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:12.453557 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.453526    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:45:12.459496 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.459478    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.462874 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.462847    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wcjvp\""
Jul 31 21:45:12.463006 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.462877    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 31 21:45:12.465486 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.465463    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:45:12.594385 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.594348    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qzc\" (UniqueName: \"kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.594502 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.594415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.695559 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.695524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qzc\" (UniqueName: \"kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.695948 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.695587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.698010 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.697988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.704859 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.704796    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qzc\" (UniqueName: \"kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc\") pod \"authorino-868c6d5c94-pr2cl\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") " pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.769512 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.769492    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:45:12.896583 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:12.896553    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:45:12.898279 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:45:12.898254    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebe602a0_6b44_4322_a6de_982a98bae7ce.slice/crio-ca1d404b85340af272000b7d65cbe69594cc45f3ec8e87bf137ad713379d45fb WatchSource:0}: Error finding container ca1d404b85340af272000b7d65cbe69594cc45f3ec8e87bf137ad713379d45fb: Status 404 returned error can't find the container with id ca1d404b85340af272000b7d65cbe69594cc45f3ec8e87bf137ad713379d45fb
Jul 31 21:45:13.634000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:13.633924    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" event={"ID":"ebe602a0-6b44-4322-a6de-982a98bae7ce","Type":"ContainerStarted","Data":"995d936f4f969b41710846fcc7ee5aa7b42e1691a2fd7f7fb6bbc1176d0e248a"}
Jul 31 21:45:13.634000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:13.633968    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" event={"ID":"ebe602a0-6b44-4322-a6de-982a98bae7ce","Type":"ContainerStarted","Data":"ca1d404b85340af272000b7d65cbe69594cc45f3ec8e87bf137ad713379d45fb"}
Jul 31 21:45:13.651627 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:13.651581    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" podStartSLOduration=1.16985764 podStartE2EDuration="1.651567034s" totalImagesPullingTime="481.709394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:45:13.649214841 +0000 UTC m=+549.437548422" watchObservedRunningTime="2026-07-31 21:45:13.651567034 +0000 UTC m=+549.439900629"
Jul 31 21:45:18.362180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:18.362147    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:18.463692 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:18.463657    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:18.718037 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:18.717947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:20.759561 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:20.759524    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:20.856277 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:20.856241    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:34.211243 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:34.211205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:53.403524 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:53.403426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:53.497956 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:53.497927    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:54.966391 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:54.966355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:55.115342 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:55.115302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:55.497497 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:55.497462    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:45:55.600382 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:45:55.600349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:01.971860 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:01.971769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:02.030345 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:02.030322    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:04.418977 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.418933    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 21:46:04.419381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.419023    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 21:46:04.883796 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.883690    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:04.934727 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.934694    2568 generic.go:356] "Generic (PLEG): container finished" podID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerID="e1c82e59106c058736822ce36418ae6f95363ed2ea554294955227e356fe7326" exitCode=0
Jul 31 21:46:04.934918 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.934779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" event={"ID":"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0","Type":"ContainerDied","Data":"e1c82e59106c058736822ce36418ae6f95363ed2ea554294955227e356fe7326"}
Jul 31 21:46:04.935221 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.935195    2568 scope.go:117] "RemoveContainer" containerID="e1c82e59106c058736822ce36418ae6f95363ed2ea554294955227e356fe7326"
Jul 31 21:46:04.936223 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.936195    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:46:04.936301 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.936267    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:46:04.936352 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.936306    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 21:46:04.963369 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:04.963329    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:05.942363 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:05.942332    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" event={"ID":"c5ef3a95-8cf1-4f12-b52c-410f61fe53f0","Type":"ContainerStarted","Data":"1c4adaef71dbe9a08bda340dfd6c4a0798099a67bb5bb712b79c20ab9df5c52e"}
Jul 31 21:46:06.176224 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:06.176182    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:46:06.176430 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:06.176347    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:46:06.176430 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:06.176391    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 21:46:07.169097 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:07.169052    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:46:07.169610 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:07.169117    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 21:46:08.168688 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:08.168647    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:46:08.169016 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:08.168983    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 21:46:09.168705 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:09.168654    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:46:09.169244 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:09.168743    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 21:46:10.169478 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:10.169436    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-qpl66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 21:46:10.170522 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:10.170083    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66" podUID="c5ef3a95-8cf1-4f12-b52c-410f61fe53f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 21:46:11.172709 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:11.172675    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:46:11.173192 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:11.173013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:46:11.174465 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:11.174442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-qpl66"
Jul 31 21:46:12.354019 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:12.353982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:28.813730 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:28.813655    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:41.315557 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.315516    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"]
Jul 31 21:46:41.319552 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.319529    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.322850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.322671    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 21:46:41.322850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.322692    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mxvc5\""
Jul 31 21:46:41.322850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.322707    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 21:46:41.322850 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.322706    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 31 21:46:41.331763 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.331738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"]
Jul 31 21:46:41.352243 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.352213    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:41.418182 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.418313 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3799080-3dbb-45bc-8740-aef336838174-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.418313 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55xn7\" (UniqueName: \"kubernetes.io/projected/a3799080-3dbb-45bc-8740-aef336838174-kube-api-access-55xn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.418313 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418289    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.418497 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.418497 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.418455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519295 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3799080-3dbb-45bc-8740-aef336838174-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519362    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55xn7\" (UniqueName: \"kubernetes.io/projected/a3799080-3dbb-45bc-8740-aef336838174-kube-api-access-55xn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519412 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519546 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519546 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519732 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519809 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.519885 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.519806    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.521655 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.521624    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3799080-3dbb-45bc-8740-aef336838174-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.521852 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.521833    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3799080-3dbb-45bc-8740-aef336838174-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.527947 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.527929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55xn7\" (UniqueName: \"kubernetes.io/projected/a3799080-3dbb-45bc-8740-aef336838174-kube-api-access-55xn7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q9ddv\" (UID: \"a3799080-3dbb-45bc-8740-aef336838174\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.632363 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.632288    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:41.766584 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.766559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"]
Jul 31 21:46:41.768479 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:46:41.768455    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3799080_3dbb_45bc_8740_aef336838174.slice/crio-f4fdae2699c7794996d2de706288d7f7993928825b236a0bd8dca602fecaba85 WatchSource:0}: Error finding container f4fdae2699c7794996d2de706288d7f7993928825b236a0bd8dca602fecaba85: Status 404 returned error can't find the container with id f4fdae2699c7794996d2de706288d7f7993928825b236a0bd8dca602fecaba85
Jul 31 21:46:41.769868 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:41.769851    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:46:42.164322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:42.164278    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv" event={"ID":"a3799080-3dbb-45bc-8740-aef336838174","Type":"ContainerStarted","Data":"f4fdae2699c7794996d2de706288d7f7993928825b236a0bd8dca602fecaba85"}
Jul 31 21:46:43.173884 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:43.173829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv" event={"ID":"a3799080-3dbb-45bc-8740-aef336838174","Type":"ContainerStarted","Data":"fc1e92e60c4f3c04ef318ae1e45887b03c3448e2bfe7ae5b43431a92127f8d86"}
Jul 31 21:46:43.201574 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:43.200952    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv" podStartSLOduration=1.241264526 podStartE2EDuration="2.200931108s" totalImagesPullingTime="959.666582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:46:43.200170361 +0000 UTC m=+638.988503934" watchObservedRunningTime="2026-07-31 21:46:43.200931108 +0000 UTC m=+638.989264683"
Jul 31 21:46:51.554938 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:51.554895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:46:51.632581 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:51.632552    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:51.632739 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:51.632608    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:51.646968 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:51.646942    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:52.237338 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:52.237309    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q9ddv"
Jul 31 21:46:57.048056 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:46:57.048012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:47:06.219708 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.219677    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"]
Jul 31 21:47:06.223613 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.223589    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.226180 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.226158    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 31 21:47:06.240515 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.240493    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"]
Jul 31 21:47:06.286607 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.286525    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:47:06.348058 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348032    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97342bc6-344a-4105-b578-0e78626a16c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.348176 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.348238 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.348276 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4l76\" (UniqueName: \"kubernetes.io/projected/97342bc6-344a-4105-b578-0e78626a16c5-kube-api-access-h4l76\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.348324 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.348360 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.348337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.448957 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.448932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.448969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4l76\" (UniqueName: \"kubernetes.io/projected/97342bc6-344a-4105-b578-0e78626a16c5-kube-api-access-h4l76\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.448992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449012    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97342bc6-344a-4105-b578-0e78626a16c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449092 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449375 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449514 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449481    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.449514 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.449494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.451346 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.451326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97342bc6-344a-4105-b578-0e78626a16c5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.451478 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.451459    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97342bc6-344a-4105-b578-0e78626a16c5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.456063 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.456042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4l76\" (UniqueName: \"kubernetes.io/projected/97342bc6-344a-4105-b578-0e78626a16c5-kube-api-access-h4l76\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cmsvf\" (UID: \"97342bc6-344a-4105-b578-0e78626a16c5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.535162 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.535138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:06.670737 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:06.670712    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"]
Jul 31 21:47:06.672469 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:47:06.672444    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97342bc6_344a_4105_b578_0e78626a16c5.slice/crio-e7b11de8f6e47a96113eb35d3043a86b86462111756c06da30d42954ce4eb7e4 WatchSource:0}: Error finding container e7b11de8f6e47a96113eb35d3043a86b86462111756c06da30d42954ce4eb7e4: Status 404 returned error can't find the container with id e7b11de8f6e47a96113eb35d3043a86b86462111756c06da30d42954ce4eb7e4
Jul 31 21:47:07.315720 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:07.315681    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf" event={"ID":"97342bc6-344a-4105-b578-0e78626a16c5","Type":"ContainerStarted","Data":"497fd4e0b1a25d399e3407031b0dba89adeb28bbb78534835738562541d7750e"}
Jul 31 21:47:07.316109 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:07.315738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf" event={"ID":"97342bc6-344a-4105-b578-0e78626a16c5","Type":"ContainerStarted","Data":"e7b11de8f6e47a96113eb35d3043a86b86462111756c06da30d42954ce4eb7e4"}
Jul 31 21:47:07.333535 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:07.333457    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf" podStartSLOduration=1.152311293 podStartE2EDuration="1.333441519s" totalImagesPullingTime="181.130226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:47:07.331680826 +0000 UTC m=+663.120014399" watchObservedRunningTime="2026-07-31 21:47:07.333441519 +0000 UTC m=+663.121775121"
Jul 31 21:47:10.510141 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:10.510101    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:47:16.535556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:16.535519    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:16.535959 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:16.535615    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:16.547501 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:16.547477    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:47:17.389152 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:47:17.389122    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cmsvf"
Jul 31 21:48:12.545337 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.545254    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:48:12.545950 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.545435    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" podUID="ebe602a0-6b44-4322-a6de-982a98bae7ce" containerName="authorino" containerID="cri-o://995d936f4f969b41710846fcc7ee5aa7b42e1691a2fd7f7fb6bbc1176d0e248a" gracePeriod=30
Jul 31 21:48:12.709414 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.709383    2568 generic.go:356] "Generic (PLEG): container finished" podID="ebe602a0-6b44-4322-a6de-982a98bae7ce" containerID="995d936f4f969b41710846fcc7ee5aa7b42e1691a2fd7f7fb6bbc1176d0e248a" exitCode=0
Jul 31 21:48:12.709568 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.709469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" event={"ID":"ebe602a0-6b44-4322-a6de-982a98bae7ce","Type":"ContainerDied","Data":"995d936f4f969b41710846fcc7ee5aa7b42e1691a2fd7f7fb6bbc1176d0e248a"}
Jul 31 21:48:12.803127 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.803073    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:48:12.809701 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.809681    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert\") pod \"ebe602a0-6b44-4322-a6de-982a98bae7ce\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") "
Jul 31 21:48:12.809799 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.809747    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6qzc\" (UniqueName: \"kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc\") pod \"ebe602a0-6b44-4322-a6de-982a98bae7ce\" (UID: \"ebe602a0-6b44-4322-a6de-982a98bae7ce\") "
Jul 31 21:48:12.811556 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.811530    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc" (OuterVolumeSpecName: "kube-api-access-n6qzc") pod "ebe602a0-6b44-4322-a6de-982a98bae7ce" (UID: "ebe602a0-6b44-4322-a6de-982a98bae7ce"). InnerVolumeSpecName "kube-api-access-n6qzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:48:12.831938 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.831868    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ebe602a0-6b44-4322-a6de-982a98bae7ce" (UID: "ebe602a0-6b44-4322-a6de-982a98bae7ce"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:48:12.910920 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.910893    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6qzc\" (UniqueName: \"kubernetes.io/projected/ebe602a0-6b44-4322-a6de-982a98bae7ce-kube-api-access-n6qzc\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:48:12.911008 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:12.910924    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ebe602a0-6b44-4322-a6de-982a98bae7ce-tls-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:48:13.031207 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.031173    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:48:13.133726 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.133665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:48:13.716509 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.716487    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-868c6d5c94-pr2cl"
Jul 31 21:48:13.716884 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.716504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-868c6d5c94-pr2cl" event={"ID":"ebe602a0-6b44-4322-a6de-982a98bae7ce","Type":"ContainerDied","Data":"ca1d404b85340af272000b7d65cbe69594cc45f3ec8e87bf137ad713379d45fb"}
Jul 31 21:48:13.716884 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.716547    2568 scope.go:117] "RemoveContainer" containerID="995d936f4f969b41710846fcc7ee5aa7b42e1691a2fd7f7fb6bbc1176d0e248a"
Jul 31 21:48:13.755185 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.755161    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:48:13.765746 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:13.765724    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-868c6d5c94-pr2cl"]
Jul 31 21:48:14.162619 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:14.162581    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:48:14.262381 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:14.262350    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:48:14.756841 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:14.756795    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe602a0-6b44-4322-a6de-982a98bae7ce" path="/var/lib/kubelet/pods/ebe602a0-6b44-4322-a6de-982a98bae7ce/volumes"
Jul 31 21:48:22.866559 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:22.866518    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:48:22.966590 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:48:22.966559    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:49:27.367603 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:49:27.367504    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:49:29.952098 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:49:29.952052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:49:30.012467 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:49:30.012431    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:49:50.367361 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:49:50.367326    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:49:50.466460 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:49:50.466431    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:50:05.222012 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:50:05.221971    2568 scope.go:117] "RemoveContainer" containerID="c8caa4b0eb9c02d03224cc0dad9131f10289d062d7245433f7829375c1aadf94"
Jul 31 21:50:19.551624 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:50:19.551588    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:50:20.800742 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:50:20.800701    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:23.599009 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:23.598975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:23.698050 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:23.698020    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:23.828377 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:23.828352    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:29.754788 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:29.754756    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:29.853266 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:29.853235    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:29.952188 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:29.952163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:31.237253 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:31.237216    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:35.840078 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:35.840049    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:51:35.934218 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:51:35.934193    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:53:24.177310 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:53:24.177261    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:54:10.058577 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:54:10.058485    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:54:53.479260 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:54:53.479224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 21:56:46.242028 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.241986    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:56:46.244511 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.242219    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerName="manager" containerID="cri-o://670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e" gracePeriod=10
Jul 31 21:56:46.268095 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.268058    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.48:8081/readyz\": dial tcp 10.133.0.48:8081: connect: connection refused"
Jul 31 21:56:46.493261 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.493210    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:56:46.536083 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.536052    2568 generic.go:356] "Generic (PLEG): container finished" podID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerID="670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e" exitCode=0
Jul 31 21:56:46.536228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.536088    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"
Jul 31 21:56:46.536228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.536128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" event={"ID":"57cef8a0-6dd3-4a05-b1e4-db4549fa49be","Type":"ContainerDied","Data":"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"}
Jul 31 21:56:46.536228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.536190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x" event={"ID":"57cef8a0-6dd3-4a05-b1e4-db4549fa49be","Type":"ContainerDied","Data":"d820b6a8f6a9783b22b7c1b4206f8fffd3af17e016dc4e9c907a04f809a8922f"}
Jul 31 21:56:46.536228 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.536223    2568 scope.go:117] "RemoveContainer" containerID="670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"
Jul 31 21:56:46.545972 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.545956    2568 scope.go:117] "RemoveContainer" containerID="670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"
Jul 31 21:56:46.546234 ip-10-0-134-210 kubenswrapper[2568]: E0731 21:56:46.546208    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e\": container with ID starting with 670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e not found: ID does not exist" containerID="670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"
Jul 31 21:56:46.546322 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.546243    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e"} err="failed to get container status \"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e\": rpc error: code = NotFound desc = could not find container \"670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e\": container with ID starting with 670cddba529dd51de38d75bf3a987e682ee8fa4a3d63a898c7336daf3366155e not found: ID does not exist"
Jul 31 21:56:46.575908 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.575887    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume\") pod \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") "
Jul 31 21:56:46.576000 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.575978    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgr52\" (UniqueName: \"kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52\") pod \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\" (UID: \"57cef8a0-6dd3-4a05-b1e4-db4549fa49be\") "
Jul 31 21:56:46.576206 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.576187    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57cef8a0-6dd3-4a05-b1e4-db4549fa49be" (UID: "57cef8a0-6dd3-4a05-b1e4-db4549fa49be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:56:46.576284 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.576271    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:56:46.577765 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.577744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52" (OuterVolumeSpecName: "kube-api-access-fgr52") pod "57cef8a0-6dd3-4a05-b1e4-db4549fa49be" (UID: "57cef8a0-6dd3-4a05-b1e4-db4549fa49be"). InnerVolumeSpecName "kube-api-access-fgr52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:56:46.676961 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.676937    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgr52\" (UniqueName: \"kubernetes.io/projected/57cef8a0-6dd3-4a05-b1e4-db4549fa49be-kube-api-access-fgr52\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 21:56:46.852663 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.852631    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:56:46.857122 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:46.857102    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7sr9x"]
Jul 31 21:56:48.757238 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:56:48.757198    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" path="/var/lib/kubelet/pods/57cef8a0-6dd3-4a05-b1e4-db4549fa49be/volumes"
Jul 31 21:57:46.957369 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957332    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 21:57:46.957829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957759    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe602a0-6b44-4322-a6de-982a98bae7ce" containerName="authorino"
Jul 31 21:57:46.957829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957772    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe602a0-6b44-4322-a6de-982a98bae7ce" containerName="authorino"
Jul 31 21:57:46.957829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957791    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerName="manager"
Jul 31 21:57:46.957829 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957797    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerName="manager"
Jul 31 21:57:46.957971 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957869    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="57cef8a0-6dd3-4a05-b1e4-db4549fa49be" containerName="manager"
Jul 31 21:57:46.957971 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.957879    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebe602a0-6b44-4322-a6de-982a98bae7ce" containerName="authorino"
Jul 31 21:57:46.960983 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.960968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:46.963115 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.963092    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7k9cd\""
Jul 31 21:57:46.973368 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:46.973341    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 21:57:47.078676 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.078651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.078831 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.078788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7b7\" (UniqueName: \"kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.180074 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.180043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.180215 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.180152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7b7\" (UniqueName: \"kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.180399 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.180380    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.191472 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.191453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7b7\" (UniqueName: \"kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7\") pod \"kuadrant-operator-controller-manager-68cf589589-9cnm2\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.270865 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.270844    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.406426 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.406393    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 21:57:47.408146 ip-10-0-134-210 kubenswrapper[2568]: W0731 21:57:47.408111    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf4ee20_d194_4a47_880a_b215c6f838e6.slice/crio-c574728ae9c9215bb0a411ea3fc7becac0bc0fa7bc157942bd8edf921aa58be7 WatchSource:0}: Error finding container c574728ae9c9215bb0a411ea3fc7becac0bc0fa7bc157942bd8edf921aa58be7: Status 404 returned error can't find the container with id c574728ae9c9215bb0a411ea3fc7becac0bc0fa7bc157942bd8edf921aa58be7
Jul 31 21:57:47.878275 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.878231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" event={"ID":"5cf4ee20-d194-4a47-880a-b215c6f838e6","Type":"ContainerStarted","Data":"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"}
Jul 31 21:57:47.878459 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.878388    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:57:47.878459 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.878433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" event={"ID":"5cf4ee20-d194-4a47-880a-b215c6f838e6","Type":"ContainerStarted","Data":"c574728ae9c9215bb0a411ea3fc7becac0bc0fa7bc157942bd8edf921aa58be7"}
Jul 31 21:57:47.901693 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:47.901635    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" podStartSLOduration=1.901621502 podStartE2EDuration="1.901621502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:57:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:57:47.900508247 +0000 UTC m=+1303.688841818" watchObservedRunningTime="2026-07-31 21:57:47.901621502 +0000 UTC m=+1303.689955075"
Jul 31 21:57:58.888518 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:57:58.888486    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 21:58:46.154774 ip-10-0-134-210 kubenswrapper[2568]: I0731 21:58:46.154732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:00:00.143905 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.143869    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"]
Jul 31 22:00:00.147671 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.147654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"
Jul 31 22:00:00.149958 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.149934    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:00:00.157260 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.157243    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"
Jul 31 22:00:00.172735 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.172700    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"]
Jul 31 22:00:00.303981 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.303959    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"]
Jul 31 22:00:00.306142 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:00:00.306114    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b5edb3_652f_4b3c_9001_7027d8caa1a5.slice/crio-6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142 WatchSource:0}: Error finding container 6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142: Status 404 returned error can't find the container with id 6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142
Jul 31 22:00:00.307929 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.307910    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:00:00.645386 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:00.645348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9" event={"ID":"f6b5edb3-652f-4b3c-9001-7027d8caa1a5","Type":"ContainerStarted","Data":"6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142"}
Jul 31 22:00:03.663132 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:03.663093    2568 generic.go:356] "Generic (PLEG): container finished" podID="f6b5edb3-652f-4b3c-9001-7027d8caa1a5" containerID="1965d9cb64af562678bb61fb2f0ae8ab4cb514aff0596fd12a2019f02d89d482" exitCode=0
Jul 31 22:00:03.663490 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:03.663172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9" event={"ID":"f6b5edb3-652f-4b3c-9001-7027d8caa1a5","Type":"ContainerDied","Data":"1965d9cb64af562678bb61fb2f0ae8ab4cb514aff0596fd12a2019f02d89d482"}
Jul 31 22:00:04.803574 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:04.803550    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"
Jul 31 22:00:05.676874 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:05.676839    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9" event={"ID":"f6b5edb3-652f-4b3c-9001-7027d8caa1a5","Type":"ContainerDied","Data":"6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142"}
Jul 31 22:00:05.677057 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:05.676917    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc462150921688dff7d66a9620fc2c408b4496f0410ad2ea4a30767e2397142"
Jul 31 22:00:05.677057 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:05.676852    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758920-kvmq9"
Jul 31 22:00:34.877017 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:34.876984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:00:39.547841 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:39.547780    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:00:49.346871 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:00:49.346828    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:01:26.861531 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:01:26.861449    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:01:27.083740 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:01:27.083708    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:01:48.948906 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:01:48.948874    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:01:49.049201 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:01:49.049170    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:02:08.046776 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:02:08.046727    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:02:08.232869 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:02:08.232832    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:02:33.255581 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:02:33.255544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:02:44.795260 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:02:44.795224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:04:46.888946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:04:46.888914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:12.799730 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:12.799689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:15.854489 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:15.854455    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:15.946704 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:15.946670    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:16.393658 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:16.393625    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:22.162860 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.162798    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:22.230645 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.230593    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:22.393722 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.393691    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:22.682773 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.682736    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:05:22.683253 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.683235    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b5edb3-652f-4b3c-9001-7027d8caa1a5" containerName="cleanup"
Jul 31 22:05:22.683352 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.683256    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b5edb3-652f-4b3c-9001-7027d8caa1a5" containerName="cleanup"
Jul 31 22:05:22.683410 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.683350    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b5edb3-652f-4b3c-9001-7027d8caa1a5" containerName="cleanup"
Jul 31 22:05:22.686560 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.686541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.689001 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.688983    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ef199660-openshift-default-dockercfg-cftht\""
Jul 31 22:05:22.710436 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.710415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:05:22.711944 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.711891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:22.832472 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832472 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832696 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832696 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832696 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832853 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832727    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832853 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832778    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832853 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7x9\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.832988 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.832872    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933553 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933479    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933553 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933553 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7x9\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.933838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934062 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934062 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934062 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.933990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934226 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.934204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934428 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.934410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934551 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.934531    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.934612 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.934594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.935479 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.935457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.935964 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.935949    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.942657 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.942633    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.942995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.942975    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7x9\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9\") pod \"e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") " pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:22.996638 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:22.996608    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:23.012216 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.012195    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:23.137588 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.137560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:05:23.139231 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:05:23.139202    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5209b9f9_f2dd_4282_b23c_d6e2d089f467.slice/crio-5f3c35f906cd7b79bdf346b4e10b379c1a5490b412ab6e3822ae04bd373044a0 WatchSource:0}: Error finding container 5f3c35f906cd7b79bdf346b4e10b379c1a5490b412ab6e3822ae04bd373044a0: Status 404 returned error can't find the container with id 5f3c35f906cd7b79bdf346b4e10b379c1a5490b412ab6e3822ae04bd373044a0
Jul 31 22:05:23.141594 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.141562    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:23.141666 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.141631    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:23.141666 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.141661    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:23.521805 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.521771    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerStarted","Data":"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"}
Jul 31 22:05:23.522166 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.521833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerStarted","Data":"5f3c35f906cd7b79bdf346b4e10b379c1a5490b412ab6e3822ae04bd373044a0"}
Jul 31 22:05:23.542607 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.542557    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podStartSLOduration=1.542543086 podStartE2EDuration="1.542543086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:05:23.538916137 +0000 UTC m=+1759.327249709" watchObservedRunningTime="2026-07-31 22:05:23.542543086 +0000 UTC m=+1759.330876659"
Jul 31 22:05:23.996892 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:23.996868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:24.890722 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:24.890681    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:24.990714 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:24.990687    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:25.001858 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:25.001834    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:25.533050 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:25.533023    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:25.533875 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:25.533851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:26.050756 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:26.050722    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:26.308912 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:26.308832    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:26.534141 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:26.534105    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:26.632765 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:26.632688    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:39.630969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.630928    2568 generic.go:356] "Generic (PLEG): container finished" podID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerID="752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7" exitCode=0
Jul 31 22:05:39.631413 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.631010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerDied","Data":"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"}
Jul 31 22:05:39.631462 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.631444    2568 scope.go:117] "RemoveContainer" containerID="752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"
Jul 31 22:05:39.632645 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.632616    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:39.632709 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.632696    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:39.632747 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:39.632731    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:05:40.533737 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:40.533685    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:40.637828 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:40.637779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerStarted","Data":"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"}
Jul 31 22:05:40.997417 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:40.997382    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:40.998449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:40.998423    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 22:05:40.998581 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:40.998476    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 22:05:41.997599 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:41.997561    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 22:05:41.998096 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:41.997631    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 22:05:42.997139 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:42.997086    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 22:05:42.997331 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:42.997157    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 22:05:43.997983 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:43.997939    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 22:05:43.998421 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:43.998013    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 22:05:44.997691 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:44.997654    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 22:05:44.997881 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:44.997721    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 22:05:46.001674 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:46.001639    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:46.002107 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:46.002021    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:46.002764 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:46.002732    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:05:50.421601 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.421553    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"]
Jul 31 22:05:50.425595 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.425573    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:50.427916 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.427887    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:05:50.432531 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.432499    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"]
Jul 31 22:05:50.488029 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.488001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef199660-w95xt\" (UID: \"1881ba93-46ff-49d1-8c73-37df8d2cd1cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:50.588587 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.588561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef199660-w95xt\" (UID: \"1881ba93-46ff-49d1-8c73-37df8d2cd1cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:50.589176 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.589158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ef199660-w95xt\" (UID: \"1881ba93-46ff-49d1-8c73-37df8d2cd1cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:50.739338 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.739316    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:50.869900 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:50.869869    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"]
Jul 31 22:05:50.871791 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:05:50.871760    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1881ba93_46ff_49d1_8c73_37df8d2cd1cb.slice/crio-b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9 WatchSource:0}: Error finding container b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9: Status 404 returned error can't find the container with id b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9
Jul 31 22:05:51.705032 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:51.705001    2568 generic.go:356] "Generic (PLEG): container finished" podID="1881ba93-46ff-49d1-8c73-37df8d2cd1cb" containerID="1778eeb8aff70354963ad634a2fab2ab9c40e710a15e0b62cb1266736e5af539" exitCode=0
Jul 31 22:05:51.705356 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:51.705058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt" event={"ID":"1881ba93-46ff-49d1-8c73-37df8d2cd1cb","Type":"ContainerDied","Data":"1778eeb8aff70354963ad634a2fab2ab9c40e710a15e0b62cb1266736e5af539"}
Jul 31 22:05:51.705356 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:51.705092    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt" event={"ID":"1881ba93-46ff-49d1-8c73-37df8d2cd1cb","Type":"ContainerStarted","Data":"b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9"}
Jul 31 22:05:52.846033 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:52.846007    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:52.909314 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:52.909285    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca\") pod \"1881ba93-46ff-49d1-8c73-37df8d2cd1cb\" (UID: \"1881ba93-46ff-49d1-8c73-37df8d2cd1cb\") "
Jul 31 22:05:52.909610 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:52.909587    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1881ba93-46ff-49d1-8c73-37df8d2cd1cb" (UID: "1881ba93-46ff-49d1-8c73-37df8d2cd1cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:05:52.909699 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:52.909686    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1881ba93-46ff-49d1-8c73-37df8d2cd1cb-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:05:53.717137 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:53.717109    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"
Jul 31 22:05:53.717296 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:53.717147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt" event={"ID":"1881ba93-46ff-49d1-8c73-37df8d2cd1cb","Type":"ContainerDied","Data":"b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9"}
Jul 31 22:05:53.717296 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:53.717226    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2ef83dfc94df900b13fcf67c4b8b7bd22c2858db167e165b021208a2e1010d9"
Jul 31 22:05:56.622360 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.622273    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:56.694240 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.694202    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:56.762332 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.762302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:56.805820 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.805793    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"]
Jul 31 22:05:56.811408 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.811383    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ef199660-w95xt"]
Jul 31 22:05:56.826947 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.826907    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:56.931601 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.931500    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:05:56.931870 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.931744    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" containerID="cri-o://22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948" gracePeriod=30
Jul 31 22:05:56.947426 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:56.947392    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:57.168961 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:57.168921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:57.430275 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:57.430217    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:57.525563 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:57.525529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:57.643874 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:57.643850    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:57.953682 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:57.953651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:58.107729 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:58.107698    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:05:58.756994 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:05:58.756963    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1881ba93-46ff-49d1-8c73-37df8d2cd1cb" path="/var/lib/kubelet/pods/1881ba93-46ff-49d1-8c73-37df8d2cd1cb/volumes"
Jul 31 22:06:01.003907 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:01.003872    2568 patch_prober.go:28] interesting pod/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 31 22:06:01.004352 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:01.003934    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 22:06:02.184416 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.184393    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:06:02.293266 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293278    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t7x9\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293316    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293366    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293390    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293409    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293677 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293435    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293677 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293474    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293677 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs\") pod \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\" (UID: \"5209b9f9-f2dd-4282-b23c-d6e2d089f467\") "
Jul 31 22:06:02.293867 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293677    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:02.293867 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.293689    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data" (OuterVolumeSpecName: "istio-data") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:02.294103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.294006    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:02.294103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.294024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:02.294103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.294033    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.294103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.294058    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:02.294103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.294070    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-data\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.295707 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.295673    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token" (OuterVolumeSpecName: "istio-token") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:02.295846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.295724    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9" (OuterVolumeSpecName: "kube-api-access-9t7x9") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "kube-api-access-9t7x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:02.295846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.295723    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:02.295846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.295757    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5209b9f9-f2dd-4282-b23c-d6e2d089f467" (UID: "5209b9f9-f2dd-4282-b23c-d6e2d089f467"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:06:02.394494 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394471    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-podinfo\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394494 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394492    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-envoy\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394624 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394501    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-credential-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394624 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394511    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istiod-ca-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394624 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394519    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5209b9f9-f2dd-4282-b23c-d6e2d089f467-workload-certs\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394624 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394527    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-istio-token\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.394624 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.394534    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t7x9\" (UniqueName: \"kubernetes.io/projected/5209b9f9-f2dd-4282-b23c-d6e2d089f467-kube-api-access-9t7x9\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.775460 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.775431    2568 generic.go:356] "Generic (PLEG): container finished" podID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerID="22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948" exitCode=0
Jul 31 22:06:02.775605 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.775470    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"
Jul 31 22:06:02.775605 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.775506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerDied","Data":"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"}
Jul 31 22:06:02.775605 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.775564    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc" event={"ID":"5209b9f9-f2dd-4282-b23c-d6e2d089f467","Type":"ContainerDied","Data":"5f3c35f906cd7b79bdf346b4e10b379c1a5490b412ab6e3822ae04bd373044a0"}
Jul 31 22:06:02.775605 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.775593    2568 scope.go:117] "RemoveContainer" containerID="22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"
Jul 31 22:06:02.787793 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.787757    2568 scope.go:117] "RemoveContainer" containerID="752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"
Jul 31 22:06:02.795936 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.795916    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:06:02.796384 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.796369    2568 scope.go:117] "RemoveContainer" containerID="22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"
Jul 31 22:06:02.796649 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:06:02.796630    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948\": container with ID starting with 22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948 not found: ID does not exist" containerID="22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"
Jul 31 22:06:02.796693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.796659    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948"} err="failed to get container status \"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948\": rpc error: code = NotFound desc = could not find container \"22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948\": container with ID starting with 22bc4859876455e71b52d749c6df5db095f83d16ccc5711bffa34086f994c948 not found: ID does not exist"
Jul 31 22:06:02.796693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.796677    2568 scope.go:117] "RemoveContainer" containerID="752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"
Jul 31 22:06:02.796951 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:06:02.796935    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7\": container with ID starting with 752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7 not found: ID does not exist" containerID="752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"
Jul 31 22:06:02.797009 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.796958    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7"} err="failed to get container status \"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7\": rpc error: code = NotFound desc = could not find container \"752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7\": container with ID starting with 752332d37bc8eedd2a92bae3caf836accd70afcc62a2e4fef42812ac70da6ab7 not found: ID does not exist"
Jul 31 22:06:02.800789 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:02.800768    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ef199660-openshift-default-67f6cd7f96-95lbc"]
Jul 31 22:06:03.097066 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:03.096984    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:03.216508 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:03.216476    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:03.762366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:03.762332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:03.859168 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:03.859133    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:04.041431 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:04.041347    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:04.758408 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:04.758368    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" path="/var/lib/kubelet/pods/5209b9f9-f2dd-4282-b23c-d6e2d089f467/volumes"
Jul 31 22:06:33.208059 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208029    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"]
Jul 31 22:06:33.208458 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208417    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:33.208458 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208428    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:33.208458 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208446    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1881ba93-46ff-49d1-8c73-37df8d2cd1cb" containerName="revoke-keys"
Jul 31 22:06:33.208458 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208453    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1881ba93-46ff-49d1-8c73-37df8d2cd1cb" containerName="revoke-keys"
Jul 31 22:06:33.208592 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208528    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:33.208592 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208536    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1881ba93-46ff-49d1-8c73-37df8d2cd1cb" containerName="revoke-keys"
Jul 31 22:06:33.208592 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.208542    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:33.211697 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.211678    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:33.214085 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.214061    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:06:33.218955 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.218926    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"]
Jul 31 22:06:33.260028 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.260002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4544f640-smzj9\" (UID: \"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:33.360889 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.360857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4544f640-smzj9\" (UID: \"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:33.361449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.361427    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4544f640-smzj9\" (UID: \"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:33.523991 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.523962    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:33.666907 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.666875    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"]
Jul 31 22:06:33.668730 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:06:33.668703    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4ae160_cfab_4ebd_950c_f5c5b58b9d38.slice/crio-77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7 WatchSource:0}: Error finding container 77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7: Status 404 returned error can't find the container with id 77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7
Jul 31 22:06:33.958310 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:33.958282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9" event={"ID":"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38","Type":"ContainerStarted","Data":"77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7"}
Jul 31 22:06:34.965549 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:34.965516    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" containerID="a3b5959aa81a614745375672f6655b11e54ce5d2c25541a1f292d2cb0febc00a" exitCode=0
Jul 31 22:06:34.965924 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:34.965579    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9" event={"ID":"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38","Type":"ContainerDied","Data":"a3b5959aa81a614745375672f6655b11e54ce5d2c25541a1f292d2cb0febc00a"}
Jul 31 22:06:36.110539 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.110516    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:36.190111 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.190082    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca\") pod \"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38\" (UID: \"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38\") "
Jul 31 22:06:36.190409 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.190386    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" (UID: "ee4ae160-cfab-4ebd-950c-f5c5b58b9d38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:36.291540 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.291516    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:06:36.978946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.978906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9" event={"ID":"ee4ae160-cfab-4ebd-950c-f5c5b58b9d38","Type":"ContainerDied","Data":"77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7"}
Jul 31 22:06:36.978946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.978935    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"
Jul 31 22:06:36.979128 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:36.978961    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77d03323c824f1cc6a2942a2f9e42526f46eaaf8977bf17fc609424cb5bc25b7"
Jul 31 22:06:38.026490 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.026453    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.122072 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.122042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.221707 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.221674    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.300625 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.300529    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"]
Jul 31 22:06:38.302336 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.302309    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.303036 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.303013    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4544f640-smzj9"]
Jul 31 22:06:38.474768 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.474718    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.670106 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.670004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:38.757550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.757519    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" path="/var/lib/kubelet/pods/ee4ae160-cfab-4ebd-950c-f5c5b58b9d38/volumes"
Jul 31 22:06:38.895971 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:38.895946    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:39.220968 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:39.220918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:39.647047 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:39.647015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:41.212395 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:41.212348    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:41.309944 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:41.309914    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:42.308577 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.308546    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:06:42.309236 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.309212    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:42.309236 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.309234    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5209b9f9-f2dd-4282-b23c-d6e2d089f467" containerName="istio-proxy"
Jul 31 22:06:42.309440 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.309269    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" containerName="revoke-keys"
Jul 31 22:06:42.309440 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.309278    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" containerName="revoke-keys"
Jul 31 22:06:42.309440 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.309388    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4ae160-cfab-4ebd-950c-f5c5b58b9d38" containerName="revoke-keys"
Jul 31 22:06:42.312732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.312712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.315378 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.315263    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8daf3c2f-serving-cert\""
Jul 31 22:06:42.315493 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.315437    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g8mcz\""
Jul 31 22:06:42.328492 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.328465    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:06:42.345024 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.344994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:42.445065 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.445033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.445065 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.445068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrv5\" (UniqueName: \"kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.445279 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.445150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.546185 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.546162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.546313 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.546190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrv5\" (UniqueName: \"kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.546313 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.546227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.546416 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:06:42.546328    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-serving-cert: secret "maas-api-e2e-ait-8daf3c2f-serving-cert" not found
Jul 31 22:06:42.546416 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:06:42.546413    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls podName:a24b0669-0949-46b6-9aa3-a219d29ad37d nodeName:}" failed. No retries permitted until 2026-07-31 22:06:43.046389201 +0000 UTC m=+1838.834722751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls") pod "maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" (UID: "a24b0669-0949-46b6-9aa3-a219d29ad37d") : secret "maas-api-e2e-ait-8daf3c2f-serving-cert" not found
Jul 31 22:06:42.546838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.546800    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.555434 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.555408    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrv5\" (UniqueName: \"kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:42.698711 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.698641    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:42.865738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.865707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:42.961469 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:42.961388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:06:43.008983 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.008957    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:06:43.014678 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.014661    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.016933 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.016917    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8daf3c2f-dockercfg-h6xnn\""
Jul 31 22:06:43.017036 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.016971    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8daf3c2f\""
Jul 31 22:06:43.022436 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.022415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:06:43.050397 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.050374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:43.052573 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.052547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") pod \"maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:43.151548 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.151514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5p6r\" (UniqueName: \"kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.151712 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.151600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.231346 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.231271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:43.252532 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.252507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5p6r\" (UniqueName: \"kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.252650 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.252575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.253250 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.253231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.261100 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.261077    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5p6r\" (UniqueName: \"kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r\") pod \"payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") " pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.328150 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.328126    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:43.378005 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.377973    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:06:43.379409 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:06:43.379385    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24b0669_0949_46b6_9aa3_a219d29ad37d.slice/crio-915db52ec5aad9d11269f4071f675ef353be735d4632913e5a7f3d30e380c86e WatchSource:0}: Error finding container 915db52ec5aad9d11269f4071f675ef353be735d4632913e5a7f3d30e380c86e: Status 404 returned error can't find the container with id 915db52ec5aad9d11269f4071f675ef353be735d4632913e5a7f3d30e380c86e
Jul 31 22:06:43.380807 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.380788    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:06:43.678396 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:43.678364    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:06:43.679871 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:06:43.679836    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9165b1b_54f7_4825_bbe2_17fe1d5d1453.slice/crio-51d9f71ebdefb6078decca8974f338cbe76459a7c2fd9f0ff32cb251017f3cea WatchSource:0}: Error finding container 51d9f71ebdefb6078decca8974f338cbe76459a7c2fd9f0ff32cb251017f3cea: Status 404 returned error can't find the container with id 51d9f71ebdefb6078decca8974f338cbe76459a7c2fd9f0ff32cb251017f3cea
Jul 31 22:06:44.024145 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:44.024109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" event={"ID":"c9165b1b-54f7-4825-bbe2-17fe1d5d1453","Type":"ContainerStarted","Data":"51d9f71ebdefb6078decca8974f338cbe76459a7c2fd9f0ff32cb251017f3cea"}
Jul 31 22:06:44.025610 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:44.025567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" event={"ID":"a24b0669-0949-46b6-9aa3-a219d29ad37d","Type":"ContainerStarted","Data":"915db52ec5aad9d11269f4071f675ef353be735d4632913e5a7f3d30e380c86e"}
Jul 31 22:06:46.040282 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.040240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" event={"ID":"a24b0669-0949-46b6-9aa3-a219d29ad37d","Type":"ContainerStarted","Data":"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"}
Jul 31 22:06:46.040707 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.040406    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:46.041738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.041714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" event={"ID":"c9165b1b-54f7-4825-bbe2-17fe1d5d1453","Type":"ContainerStarted","Data":"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"}
Jul 31 22:06:46.041882 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.041774    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:06:46.057231 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.057188    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" podStartSLOduration=2.459101734 podStartE2EDuration="4.05717437s" totalImagesPullingTime="1.598072636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:46.055261368 +0000 UTC m=+1841.843594942" watchObservedRunningTime="2026-07-31 22:06:46.05717437 +0000 UTC m=+1841.845507944"
Jul 31 22:06:46.071900 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:46.071863    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" podStartSLOduration=2.334031672 podStartE2EDuration="4.07185091s" totalImagesPullingTime="1.737819238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:46.06952756 +0000 UTC m=+1841.857861145" watchObservedRunningTime="2026-07-31 22:06:46.07185091 +0000 UTC m=+1841.860184483"
Jul 31 22:06:52.053692 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:52.053661    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:06:57.049938 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:06:57.049907    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:07:07.097322 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.097285    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"]
Jul 31 22:07:07.102601 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.102580    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:07.105521 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.105502    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:07:07.118741 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.118717    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"]
Jul 31 22:07:07.171144 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.171118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx\" (UID: \"9aec3e7f-e23f-481c-b707-094b673518d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:07.272308 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.272287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx\" (UID: \"9aec3e7f-e23f-481c-b707-094b673518d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:07.272922 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.272902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx\" (UID: \"9aec3e7f-e23f-481c-b707-094b673518d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:07.414257 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.414198    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:07.544888 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:07.544861    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"]
Jul 31 22:07:07.546666 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:07:07.546642    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aec3e7f_e23f_481c_b707_094b673518d3.slice/crio-d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8 WatchSource:0}: Error finding container d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8: Status 404 returned error can't find the container with id d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8
Jul 31 22:07:08.175294 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:08.175199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx" event={"ID":"9aec3e7f-e23f-481c-b707-094b673518d3","Type":"ContainerStarted","Data":"88f6b376e65c73df1e1d8ed4547b619951e8fffbf65f9f6aeca47d7a69431724"}
Jul 31 22:07:08.175294 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:08.175264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx" event={"ID":"9aec3e7f-e23f-481c-b707-094b673518d3","Type":"ContainerStarted","Data":"d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8"}
Jul 31 22:07:08.189311 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:08.189262    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx" podStartSLOduration=1.1892463659999999 podStartE2EDuration="1.189246366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:08.187996035 +0000 UTC m=+1863.976329608" watchObservedRunningTime="2026-07-31 22:07:08.189246366 +0000 UTC m=+1863.977579938"
Jul 31 22:07:09.182909 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:09.182871    2568 generic.go:356] "Generic (PLEG): container finished" podID="9aec3e7f-e23f-481c-b707-094b673518d3" containerID="88f6b376e65c73df1e1d8ed4547b619951e8fffbf65f9f6aeca47d7a69431724" exitCode=0
Jul 31 22:07:09.183362 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:09.182961    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx" event={"ID":"9aec3e7f-e23f-481c-b707-094b673518d3","Type":"ContainerDied","Data":"88f6b376e65c73df1e1d8ed4547b619951e8fffbf65f9f6aeca47d7a69431724"}
Jul 31 22:07:10.326292 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:10.326269    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:10.398636 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:10.398609    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca\") pod \"9aec3e7f-e23f-481c-b707-094b673518d3\" (UID: \"9aec3e7f-e23f-481c-b707-094b673518d3\") "
Jul 31 22:07:10.398969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:10.398941    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9aec3e7f-e23f-481c-b707-094b673518d3" (UID: "9aec3e7f-e23f-481c-b707-094b673518d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:10.499524 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:10.499499    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aec3e7f-e23f-481c-b707-094b673518d3-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:11.197030 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:11.196952    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"
Jul 31 22:07:11.197030 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:11.196987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx" event={"ID":"9aec3e7f-e23f-481c-b707-094b673518d3","Type":"ContainerDied","Data":"d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8"}
Jul 31 22:07:11.197206 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:11.197057    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d58d7810a7dc2214707da6d80cd685b86ac7dfb71e47175b8240c6cf8b05e3f8"
Jul 31 22:07:12.831352 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.831314    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:07:12.831936 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.831535    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" podUID="a24b0669-0949-46b6-9aa3-a219d29ad37d" containerName="maas-api" containerID="cri-o://f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa" gracePeriod=30
Jul 31 22:07:12.856917 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.856886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:12.884805 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.884775    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:07:12.885014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.884988    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" podUID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" containerName="payload-processing" containerID="cri-o://8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160" gracePeriod=30
Jul 31 22:07:12.957679 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:12.957651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:13.042303 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.042268    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"]
Jul 31 22:07:13.043760 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.043727    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:13.045192 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.045171    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8daf3c2f-hlnlx"]
Jul 31 22:07:13.109397 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.109327    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:13.138485 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.138456    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:07:13.158206 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.158182    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:07:13.210962 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.210927    2568 generic.go:356] "Generic (PLEG): container finished" podID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" containerID="8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160" exitCode=0
Jul 31 22:07:13.211087 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.210966    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"
Jul 31 22:07:13.211087 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.211017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" event={"ID":"c9165b1b-54f7-4825-bbe2-17fe1d5d1453","Type":"ContainerDied","Data":"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"}
Jul 31 22:07:13.211087 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.211064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt" event={"ID":"c9165b1b-54f7-4825-bbe2-17fe1d5d1453","Type":"ContainerDied","Data":"51d9f71ebdefb6078decca8974f338cbe76459a7c2fd9f0ff32cb251017f3cea"}
Jul 31 22:07:13.211220 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.211095    2568 scope.go:117] "RemoveContainer" containerID="8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"
Jul 31 22:07:13.212405 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.212379    2568 generic.go:356] "Generic (PLEG): container finished" podID="a24b0669-0949-46b6-9aa3-a219d29ad37d" containerID="f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa" exitCode=0
Jul 31 22:07:13.212522 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.212422    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"
Jul 31 22:07:13.212522 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.212447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" event={"ID":"a24b0669-0949-46b6-9aa3-a219d29ad37d","Type":"ContainerDied","Data":"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"}
Jul 31 22:07:13.212522 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.212481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv" event={"ID":"a24b0669-0949-46b6-9aa3-a219d29ad37d","Type":"ContainerDied","Data":"915db52ec5aad9d11269f4071f675ef353be735d4632913e5a7f3d30e380c86e"}
Jul 31 22:07:13.220142 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.220121    2568 scope.go:117] "RemoveContainer" containerID="8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"
Jul 31 22:07:13.220382 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:13.220362    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160\": container with ID starting with 8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160 not found: ID does not exist" containerID="8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"
Jul 31 22:07:13.220439 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.220389    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160"} err="failed to get container status \"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160\": rpc error: code = NotFound desc = could not find container \"8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160\": container with ID starting with 8e057d37541d7763ce77d69c4018fa4d937101449472225a55faeaff354ba160 not found: ID does not exist"
Jul 31 22:07:13.220439 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.220405    2568 scope.go:117] "RemoveContainer" containerID="f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"
Jul 31 22:07:13.222533 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222514    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcrv5\" (UniqueName: \"kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5\") pod \"a24b0669-0949-46b6-9aa3-a219d29ad37d\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") "
Jul 31 22:07:13.222642 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222582    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca\") pod \"a24b0669-0949-46b6-9aa3-a219d29ad37d\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") "
Jul 31 22:07:13.222705 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222639    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5p6r\" (UniqueName: \"kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r\") pod \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") "
Jul 31 22:07:13.222766 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222699    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") pod \"a24b0669-0949-46b6-9aa3-a219d29ad37d\" (UID: \"a24b0669-0949-46b6-9aa3-a219d29ad37d\") "
Jul 31 22:07:13.222766 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222734    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume\") pod \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\" (UID: \"c9165b1b-54f7-4825-bbe2-17fe1d5d1453\") "
Jul 31 22:07:13.223082 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.222983    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a24b0669-0949-46b6-9aa3-a219d29ad37d" (UID: "a24b0669-0949-46b6-9aa3-a219d29ad37d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:13.223190 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.223171    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9165b1b-54f7-4825-bbe2-17fe1d5d1453" (UID: "c9165b1b-54f7-4825-bbe2-17fe1d5d1453"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:13.224835 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.224800    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5" (OuterVolumeSpecName: "kube-api-access-rcrv5") pod "a24b0669-0949-46b6-9aa3-a219d29ad37d" (UID: "a24b0669-0949-46b6-9aa3-a219d29ad37d"). InnerVolumeSpecName "kube-api-access-rcrv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:13.224835 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.224825    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r" (OuterVolumeSpecName: "kube-api-access-f5p6r") pod "c9165b1b-54f7-4825-bbe2-17fe1d5d1453" (UID: "c9165b1b-54f7-4825-bbe2-17fe1d5d1453"). InnerVolumeSpecName "kube-api-access-f5p6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:13.225034 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.225009    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a24b0669-0949-46b6-9aa3-a219d29ad37d" (UID: "a24b0669-0949-46b6-9aa3-a219d29ad37d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:07:13.228998 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.228981    2568 scope.go:117] "RemoveContainer" containerID="f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"
Jul 31 22:07:13.229258 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:13.229238    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa\": container with ID starting with f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa not found: ID does not exist" containerID="f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"
Jul 31 22:07:13.229308 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.229265    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa"} err="failed to get container status \"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa\": rpc error: code = NotFound desc = could not find container \"f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa\": container with ID starting with f1339668ff944fd408444120ee9b97f08c3420f59ee3afef769804b2099b8cfa not found: ID does not exist"
Jul 31 22:07:13.323958 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.323936    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a24b0669-0949-46b6-9aa3-a219d29ad37d-maas-api-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:13.323958 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.323957    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:13.324078 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.323967    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcrv5\" (UniqueName: \"kubernetes.io/projected/a24b0669-0949-46b6-9aa3-a219d29ad37d-kube-api-access-rcrv5\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:13.324078 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.323976    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a24b0669-0949-46b6-9aa3-a219d29ad37d-openshift-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:13.324078 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.323984    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5p6r\" (UniqueName: \"kubernetes.io/projected/c9165b1b-54f7-4825-bbe2-17fe1d5d1453-kube-api-access-f5p6r\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:13.537808 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.537780    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:07:13.543717 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.543692    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8daf3c2f-7f6f998f95-mncfv"]
Jul 31 22:07:13.553282 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.553261    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:07:13.558964 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:13.558936    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8daf3c2f-66679b674-8c8wt"]
Jul 31 22:07:14.277117 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.277079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:14.496804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.496771    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:14.725034 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.724950    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:14.757515 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.757482    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aec3e7f-e23f-481c-b707-094b673518d3" path="/var/lib/kubelet/pods/9aec3e7f-e23f-481c-b707-094b673518d3/volumes"
Jul 31 22:07:14.757972 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.757951    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24b0669-0949-46b6-9aa3-a219d29ad37d" path="/var/lib/kubelet/pods/a24b0669-0949-46b6-9aa3-a219d29ad37d/volumes"
Jul 31 22:07:14.758340 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:14.758325    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" path="/var/lib/kubelet/pods/c9165b1b-54f7-4825-bbe2-17fe1d5d1453/volumes"
Jul 31 22:07:15.040002 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:15.039961    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:15.139031 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:15.138997    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:17.454740 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:17.454707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:17.524255 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:17.524224    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:18.507356 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.507320    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:18.507969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.507952    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" containerName="payload-processing"
Jul 31 22:07:18.508020 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.507973    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" containerName="payload-processing"
Jul 31 22:07:18.508020 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.507986    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aec3e7f-e23f-481c-b707-094b673518d3" containerName="revoke-keys"
Jul 31 22:07:18.508020 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.507995    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aec3e7f-e23f-481c-b707-094b673518d3" containerName="revoke-keys"
Jul 31 22:07:18.508119 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.508035    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24b0669-0949-46b6-9aa3-a219d29ad37d" containerName="maas-api"
Jul 31 22:07:18.508119 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.508044    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24b0669-0949-46b6-9aa3-a219d29ad37d" containerName="maas-api"
Jul 31 22:07:18.508184 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.508131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24b0669-0949-46b6-9aa3-a219d29ad37d" containerName="maas-api"
Jul 31 22:07:18.508184 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.508140    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9165b1b-54f7-4825-bbe2-17fe1d5d1453" containerName="payload-processing"
Jul 31 22:07:18.508184 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.508154    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aec3e7f-e23f-481c-b707-094b673518d3" containerName="revoke-keys"
Jul 31 22:07:18.514446 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.514424    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.516703 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.516681    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g8mcz\""
Jul 31 22:07:18.517045 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.517017    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e3a03c45-serving-cert\""
Jul 31 22:07:18.518620 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.518596    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:18.541184 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.541165    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:18.570550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.570526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.570659 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.570566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.570659 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.570605    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxztl\" (UniqueName: \"kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.671503 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.671473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.671687 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.671509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.671687 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.671539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxztl\" (UniqueName: \"kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.671687 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:18.671647    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-serving-cert: secret "maas-api-e2e-derive-e3a03c45-serving-cert" not found
Jul 31 22:07:18.671910 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:18.671735    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls podName:a1c27861-06a7-4c7a-a219-f5f921d586d4 nodeName:}" failed. No retries permitted until 2026-07-31 22:07:19.171712966 +0000 UTC m=+1874.960046519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls") pod "maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" (UID: "a1c27861-06a7-4c7a-a219-f5f921d586d4") : secret "maas-api-e2e-derive-e3a03c45-serving-cert" not found
Jul 31 22:07:18.672210 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.672188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:18.679884 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:18.679862    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxztl\" (UniqueName: \"kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:19.040695 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.040665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:19.140163 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.140132    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:19.175871 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.175842    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:19.176739 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.176714    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:19.178601 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.178575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") pod \"maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:19.181318 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.181298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.183575 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.183555    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-e3a03c45\""
Jul 31 22:07:19.186637 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.184232    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-e3a03c45-dockercfg-b4ztw\""
Jul 31 22:07:19.194714 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.194689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:19.276964 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.276919    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.277148 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.277114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkxwt\" (UniqueName: \"kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.378552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.378466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkxwt\" (UniqueName: \"kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.378689 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.378562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.379285 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.379265    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.389014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.388992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkxwt\" (UniqueName: \"kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt\") pod \"payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") " pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.426963 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.426928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:19.503320 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.503290    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:19.566840 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.566780    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:19.569783 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:07:19.569699    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c27861_06a7_4c7a_a219_f5f921d586d4.slice/crio-8934009b68fe1d6cdfe976665e8eddc8d908d499dc7fb29da2e2c15386780917 WatchSource:0}: Error finding container 8934009b68fe1d6cdfe976665e8eddc8d908d499dc7fb29da2e2c15386780917: Status 404 returned error can't find the container with id 8934009b68fe1d6cdfe976665e8eddc8d908d499dc7fb29da2e2c15386780917
Jul 31 22:07:19.652083 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:19.652053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:19.653344 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:07:19.653313    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c72a8ab_d527_4e0f_8f0d_01c3e2bb6da9.slice/crio-931667d810ca8090a2df926b6af9aa05cb7001472575aefa2a97556e243ca944 WatchSource:0}: Error finding container 931667d810ca8090a2df926b6af9aa05cb7001472575aefa2a97556e243ca944: Status 404 returned error can't find the container with id 931667d810ca8090a2df926b6af9aa05cb7001472575aefa2a97556e243ca944
Jul 31 22:07:20.256875 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.256836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" event={"ID":"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9","Type":"ContainerStarted","Data":"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"}
Jul 31 22:07:20.257060 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.256913    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" event={"ID":"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9","Type":"ContainerStarted","Data":"931667d810ca8090a2df926b6af9aa05cb7001472575aefa2a97556e243ca944"}
Jul 31 22:07:20.257060 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.256948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:20.258505 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.258476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" event={"ID":"a1c27861-06a7-4c7a-a219-f5f921d586d4","Type":"ContainerStarted","Data":"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"}
Jul 31 22:07:20.258612 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.258528    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" event={"ID":"a1c27861-06a7-4c7a-a219-f5f921d586d4","Type":"ContainerStarted","Data":"8934009b68fe1d6cdfe976665e8eddc8d908d499dc7fb29da2e2c15386780917"}
Jul 31 22:07:20.258612 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.258555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:20.274954 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.274913    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" podStartSLOduration=1.274896215 podStartE2EDuration="1.274896215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:20.271625708 +0000 UTC m=+1876.059959282" watchObservedRunningTime="2026-07-31 22:07:20.274896215 +0000 UTC m=+1876.063229789"
Jul 31 22:07:20.287275 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:20.287239    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" podStartSLOduration=1.8826381159999999 podStartE2EDuration="2.287228257s" totalImagesPullingTime="404.590141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:20.286896963 +0000 UTC m=+1876.075230546" watchObservedRunningTime="2026-07-31 22:07:20.287228257 +0000 UTC m=+1876.075561829"
Jul 31 22:07:26.269276 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:26.269246    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:31.265988 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:31.265959    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:33.148598 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:33.148562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:33.214092 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:33.214065    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:42.303804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.303764    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"]
Jul 31 22:07:42.307722 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.307701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:42.310328 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.310284    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:07:42.314778 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.314743    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"]
Jul 31 22:07:42.385156 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.385130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f\" (UID: \"66b434b5-1bcc-41a9-85c7-df98cf5288e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:42.486434 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.486405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f\" (UID: \"66b434b5-1bcc-41a9-85c7-df98cf5288e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:42.486971 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.486955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f\" (UID: \"66b434b5-1bcc-41a9-85c7-df98cf5288e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:42.623987 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.623926    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:42.762424 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:42.762394    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"]
Jul 31 22:07:42.764226 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:07:42.764196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b434b5_1bcc_41a9_85c7_df98cf5288e9.slice/crio-e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe WatchSource:0}: Error finding container e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe: Status 404 returned error can't find the container with id e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe
Jul 31 22:07:43.407831 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:43.407745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f" event={"ID":"66b434b5-1bcc-41a9-85c7-df98cf5288e9","Type":"ContainerStarted","Data":"492eba0b176f6cf5cc5c1cce174e4f7c173b134f1385e75c4a0bb758ce2940a1"}
Jul 31 22:07:43.407831 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:43.407796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f" event={"ID":"66b434b5-1bcc-41a9-85c7-df98cf5288e9","Type":"ContainerStarted","Data":"e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe"}
Jul 31 22:07:43.427015 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:43.426965    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f" podStartSLOduration=1.42694914 podStartE2EDuration="1.42694914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:43.426062087 +0000 UTC m=+1899.214395652" watchObservedRunningTime="2026-07-31 22:07:43.42694914 +0000 UTC m=+1899.215282712"
Jul 31 22:07:44.415647 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:44.415615    2568 generic.go:356] "Generic (PLEG): container finished" podID="66b434b5-1bcc-41a9-85c7-df98cf5288e9" containerID="492eba0b176f6cf5cc5c1cce174e4f7c173b134f1385e75c4a0bb758ce2940a1" exitCode=0
Jul 31 22:07:44.416070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:44.415708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f" event={"ID":"66b434b5-1bcc-41a9-85c7-df98cf5288e9","Type":"ContainerDied","Data":"492eba0b176f6cf5cc5c1cce174e4f7c173b134f1385e75c4a0bb758ce2940a1"}
Jul 31 22:07:45.550995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:45.550970    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:45.716270 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:45.716212    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca\") pod \"66b434b5-1bcc-41a9-85c7-df98cf5288e9\" (UID: \"66b434b5-1bcc-41a9-85c7-df98cf5288e9\") "
Jul 31 22:07:45.716534 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:45.716512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66b434b5-1bcc-41a9-85c7-df98cf5288e9" (UID: "66b434b5-1bcc-41a9-85c7-df98cf5288e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:45.817528 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:45.817502    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66b434b5-1bcc-41a9-85c7-df98cf5288e9-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:46.436792 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:46.436757    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"
Jul 31 22:07:46.436972 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:46.436760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f" event={"ID":"66b434b5-1bcc-41a9-85c7-df98cf5288e9","Type":"ContainerDied","Data":"e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe"}
Jul 31 22:07:46.436972 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:46.436918    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e68b6ff1b0c8661f590d56194b101c18f3078ed01697668732e48b2f300032fe"
Jul 31 22:07:49.099491 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.098898    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:49.099491 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.099230    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" podUID="a1c27861-06a7-4c7a-a219-f5f921d586d4" containerName="maas-api" containerID="cri-o://fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25" gracePeriod=30
Jul 31 22:07:49.131229 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.131199    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.162805 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.162778    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:49.163019 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.162991    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" podUID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" containerName="payload-processing" containerID="cri-o://08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141" gracePeriod=30
Jul 31 22:07:49.232705 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.232680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.312056 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.312018    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"]
Jul 31 22:07:49.312964 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.312940    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.314735 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.314708    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e3a03c45-pch5f"]
Jul 31 22:07:49.429550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.429503    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:49.435752 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.435716    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.445457 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.445436    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:49.458296 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.458273    2568 generic.go:356] "Generic (PLEG): container finished" podID="a1c27861-06a7-4c7a-a219-f5f921d586d4" containerID="fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25" exitCode=0
Jul 31 22:07:49.458437 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.458311    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"
Jul 31 22:07:49.458437 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.458362    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" event={"ID":"a1c27861-06a7-4c7a-a219-f5f921d586d4","Type":"ContainerDied","Data":"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"}
Jul 31 22:07:49.458437 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.458422    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd" event={"ID":"a1c27861-06a7-4c7a-a219-f5f921d586d4","Type":"ContainerDied","Data":"8934009b68fe1d6cdfe976665e8eddc8d908d499dc7fb29da2e2c15386780917"}
Jul 31 22:07:49.458610 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.458454    2568 scope.go:117] "RemoveContainer" containerID="fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"
Jul 31 22:07:49.460124 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.460100    2568 generic.go:356] "Generic (PLEG): container finished" podID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" containerID="08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141" exitCode=0
Jul 31 22:07:49.460251 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.460139    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"
Jul 31 22:07:49.460251 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.460160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" event={"ID":"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9","Type":"ContainerDied","Data":"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"}
Jul 31 22:07:49.460251 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.460194    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv" event={"ID":"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9","Type":"ContainerDied","Data":"931667d810ca8090a2df926b6af9aa05cb7001472575aefa2a97556e243ca944"}
Jul 31 22:07:49.470307 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.470135    2568 scope.go:117] "RemoveContainer" containerID="fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"
Jul 31 22:07:49.470466 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:49.470440    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25\": container with ID starting with fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25 not found: ID does not exist" containerID="fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"
Jul 31 22:07:49.470537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.470477    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25"} err="failed to get container status \"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25\": rpc error: code = NotFound desc = could not find container \"fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25\": container with ID starting with fc9162ba4e1ed055231bef3f42c50971068265be96b9216345d2a7f90b713f25 not found: ID does not exist"
Jul 31 22:07:49.470537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.470499    2568 scope.go:117] "RemoveContainer" containerID="08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"
Jul 31 22:07:49.479377 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.479355    2568 scope.go:117] "RemoveContainer" containerID="08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"
Jul 31 22:07:49.479641 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:07:49.479615    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141\": container with ID starting with 08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141 not found: ID does not exist" containerID="08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"
Jul 31 22:07:49.479723 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.479649    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141"} err="failed to get container status \"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141\": rpc error: code = NotFound desc = could not find container \"08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141\": container with ID starting with 08487766907bb0fe9da65b15dc3c66dff23c1e72438e6a8a2270089df833a141 not found: ID does not exist"
Jul 31 22:07:49.498187 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.498162    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.552240 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552210    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxztl\" (UniqueName: \"kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl\") pod \"a1c27861-06a7-4c7a-a219-f5f921d586d4\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") "
Jul 31 22:07:49.552378 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552273    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") pod \"a1c27861-06a7-4c7a-a219-f5f921d586d4\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") "
Jul 31 22:07:49.552426 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552383    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkxwt\" (UniqueName: \"kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt\") pod \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") "
Jul 31 22:07:49.552466 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552422    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca\") pod \"a1c27861-06a7-4c7a-a219-f5f921d586d4\" (UID: \"a1c27861-06a7-4c7a-a219-f5f921d586d4\") "
Jul 31 22:07:49.552511 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume\") pod \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\" (UID: \"1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9\") "
Jul 31 22:07:49.552915 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552885    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1c27861-06a7-4c7a-a219-f5f921d586d4" (UID: "a1c27861-06a7-4c7a-a219-f5f921d586d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:49.553055 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.552934    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" (UID: "1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:49.554791 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.554769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1c27861-06a7-4c7a-a219-f5f921d586d4" (UID: "a1c27861-06a7-4c7a-a219-f5f921d586d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:07:49.555014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.554876    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl" (OuterVolumeSpecName: "kube-api-access-fxztl") pod "a1c27861-06a7-4c7a-a219-f5f921d586d4" (UID: "a1c27861-06a7-4c7a-a219-f5f921d586d4"). InnerVolumeSpecName "kube-api-access-fxztl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:49.555014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.554982    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt" (OuterVolumeSpecName: "kube-api-access-qkxwt") pod "1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" (UID: "1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9"). InnerVolumeSpecName "kube-api-access-qkxwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:49.653895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.653836    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkxwt\" (UniqueName: \"kubernetes.io/projected/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-kube-api-access-qkxwt\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:49.653895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.653859    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c27861-06a7-4c7a-a219-f5f921d586d4-openshift-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:49.653895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.653869    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:49.653895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.653878    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxztl\" (UniqueName: \"kubernetes.io/projected/a1c27861-06a7-4c7a-a219-f5f921d586d4-kube-api-access-fxztl\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:49.653895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.653886    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c27861-06a7-4c7a-a219-f5f921d586d4-maas-api-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:07:49.697771 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.697750    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:49.781329 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.781308    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:49.783759 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.783740    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e3a03c45-7c97d98dbc-sczpd"]
Jul 31 22:07:49.793704 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.793685    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:49.797686 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.797667    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-e3a03c45-7596589ddb-dkqxv"]
Jul 31 22:07:49.831068 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:49.831044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:50.162536 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.162503    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:50.254616 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.254592    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:50.354857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.354810    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:07:50.757254 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.757222    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" path="/var/lib/kubelet/pods/1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9/volumes"
Jul 31 22:07:50.757555 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.757541    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66b434b5-1bcc-41a9-85c7-df98cf5288e9" path="/var/lib/kubelet/pods/66b434b5-1bcc-41a9-85c7-df98cf5288e9/volumes"
Jul 31 22:07:50.757917 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:07:50.757904    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c27861-06a7-4c7a-a219-f5f921d586d4" path="/var/lib/kubelet/pods/a1c27861-06a7-4c7a-a219-f5f921d586d4/volumes"
Jul 31 22:08:02.038300 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:02.038262    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:08.445832 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:08.445770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:08.551763 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:08.551732    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:08.642381 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:08.642342    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:08.744441 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:08.744417    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:09.171957 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:09.171877    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:35.171527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:35.171495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:41.192683 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:41.192645    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:41.261032 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:41.260994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:41.348257 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:41.348227    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:41.448672 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:41.448609    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:08:57.345902 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:08:57.345799    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:03.125366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:03.125331    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:03.191113 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:03.191082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:03.287630 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:03.287595    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:03.379984 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:03.379926    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:13.880002 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:13.879962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:13.981339 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:13.981306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:15.437519 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:15.437485    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:24.953233 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:24.953196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:31.023808 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:31.023774    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:31.089403 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:31.089373    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:31.168593 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:31.168564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:31.266112 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:31.266083    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:31.365948 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:31.365885    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:32.053426 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:32.053362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:32.149311 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:32.149280    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:32.249871 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:32.249837    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:33.809597 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:33.809562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:40.683790 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:40.683753    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:40.785399 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:40.785370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:41.396312 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:41.396281    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:47.988395 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:47.988361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:48.084263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:48.084236    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:48.227226 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:48.227196    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:48.576836 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:48.576787    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:49.855722 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:49.855672    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:51.806021 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:51.805989    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:51.904548 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:51.904520    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:53.081650 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.081617    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:53.186725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.186695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:53.610898 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.610865    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:53.714188 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.714153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:09:53.797877 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.797843    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:09:53.798296 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798281    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" containerName="payload-processing"
Jul 31 22:09:53.798361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798297    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" containerName="payload-processing"
Jul 31 22:09:53.798361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798313    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c27861-06a7-4c7a-a219-f5f921d586d4" containerName="maas-api"
Jul 31 22:09:53.798361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798318    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c27861-06a7-4c7a-a219-f5f921d586d4" containerName="maas-api"
Jul 31 22:09:53.798361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798336    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b434b5-1bcc-41a9-85c7-df98cf5288e9" containerName="revoke-keys"
Jul 31 22:09:53.798361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798342    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b434b5-1bcc-41a9-85c7-df98cf5288e9" containerName="revoke-keys"
Jul 31 22:09:53.798526 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798406    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c72a8ab-d527-4e0f-8f0d-01c3e2bb6da9" containerName="payload-processing"
Jul 31 22:09:53.798526 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798416    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c27861-06a7-4c7a-a219-f5f921d586d4" containerName="maas-api"
Jul 31 22:09:53.798526 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.798426    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="66b434b5-1bcc-41a9-85c7-df98cf5288e9" containerName="revoke-keys"
Jul 31 22:09:53.801653 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.801635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:53.803873 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.803852    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-723a1787-dockercfg-2kcw8\""
Jul 31 22:09:53.803979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.803937    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-723a1787\""
Jul 31 22:09:53.808451 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.808430    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:09:53.918935 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.918845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:53.919102 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:53.918978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mf8s\" (UniqueName: \"kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.019831 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.019781    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mf8s\" (UniqueName: \"kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.019978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.019888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.020515 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.020497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.027191 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.027162    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mf8s\" (UniqueName: \"kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s\") pod \"payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.114576 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.114551    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:54.250788 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:54.250764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:09:54.252609 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:09:54.252578    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa5ab3c_2cc7_46f1_8635_94ced879b86b.slice/crio-6008c7e4f3e8dbf9064532d6840397361e124efc444cffde8daae4dd2ff87027 WatchSource:0}: Error finding container 6008c7e4f3e8dbf9064532d6840397361e124efc444cffde8daae4dd2ff87027: Status 404 returned error can't find the container with id 6008c7e4f3e8dbf9064532d6840397361e124efc444cffde8daae4dd2ff87027
Jul 31 22:09:55.207450 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:55.207418    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" event={"ID":"faa5ab3c-2cc7-46f1-8635-94ced879b86b","Type":"ContainerStarted","Data":"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"}
Jul 31 22:09:55.207891 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:55.207474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" event={"ID":"faa5ab3c-2cc7-46f1-8635-94ced879b86b","Type":"ContainerStarted","Data":"6008c7e4f3e8dbf9064532d6840397361e124efc444cffde8daae4dd2ff87027"}
Jul 31 22:09:55.207891 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:55.207502    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:09:55.226266 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:09:55.226222    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" podStartSLOduration=2.226206692 podStartE2EDuration="2.226206692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:09:55.223911948 +0000 UTC m=+2031.012245522" watchObservedRunningTime="2026-07-31 22:09:55.226206692 +0000 UTC m=+2031.014540289"
Jul 31 22:10:06.217046 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:06.217017    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:10:16.869306 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:16.869244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:17.560882 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:17.560834    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:17.657498 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:17.657445    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:18.046478 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:18.046450    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:23.698001 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:23.697968    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:23.766591 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:23.766562    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:24.080611 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.080585    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"]
Jul 31 22:10:24.084299 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.084283    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:24.086473 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.086448    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:10:24.091606 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.091582    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"]
Jul 31 22:10:24.177695 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.177668    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723a1787-fr7qn\" (UID: \"2da5db0e-408d-4987-99d7-1ca61a79f2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:24.278440 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.278412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723a1787-fr7qn\" (UID: \"2da5db0e-408d-4987-99d7-1ca61a79f2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:24.279095 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.279075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-723a1787-fr7qn\" (UID: \"2da5db0e-408d-4987-99d7-1ca61a79f2b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:24.396579 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.396522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:24.530330 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:24.530301    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"]
Jul 31 22:10:24.532385 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:10:24.532356    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da5db0e_408d_4987_99d7_1ca61a79f2b4.slice/crio-8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4 WatchSource:0}: Error finding container 8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4: Status 404 returned error can't find the container with id 8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4
Jul 31 22:10:25.388682 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:25.388658    2568 generic.go:356] "Generic (PLEG): container finished" podID="2da5db0e-408d-4987-99d7-1ca61a79f2b4" containerID="a219aa1aed942fa9f987740c7e202e15b75f8bc0743e013e33eaba8a53c19a7f" exitCode=0
Jul 31 22:10:25.389017 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:25.388740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn" event={"ID":"2da5db0e-408d-4987-99d7-1ca61a79f2b4","Type":"ContainerDied","Data":"a219aa1aed942fa9f987740c7e202e15b75f8bc0743e013e33eaba8a53c19a7f"}
Jul 31 22:10:25.389017 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:25.388788    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn" event={"ID":"2da5db0e-408d-4987-99d7-1ca61a79f2b4","Type":"ContainerStarted","Data":"8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4"}
Jul 31 22:10:26.527162 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:26.527136    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:26.699148 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:26.699076    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca\") pod \"2da5db0e-408d-4987-99d7-1ca61a79f2b4\" (UID: \"2da5db0e-408d-4987-99d7-1ca61a79f2b4\") "
Jul 31 22:10:26.699403 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:26.699379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2da5db0e-408d-4987-99d7-1ca61a79f2b4" (UID: "2da5db0e-408d-4987-99d7-1ca61a79f2b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:10:26.699498 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:26.699479    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da5db0e-408d-4987-99d7-1ca61a79f2b4-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:10:27.402263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:27.402228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn" event={"ID":"2da5db0e-408d-4987-99d7-1ca61a79f2b4","Type":"ContainerDied","Data":"8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4"}
Jul 31 22:10:27.402263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:27.402257    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"
Jul 31 22:10:27.402484 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:27.402277    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8febff35d252b3631a71b87773c7cb6dc468c1726ba0849014630f96b547e8f4"
Jul 31 22:10:31.766773 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:31.766738    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:34.561454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.561415    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:34.601343 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.601311    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:10:34.601552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.601520    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" podUID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" containerName="payload-pre-processing" containerID="cri-o://4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829" gracePeriod=30
Jul 31 22:10:34.657414 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.657381    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:34.740455 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.740429    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"]
Jul 31 22:10:34.741999 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.741972    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:34.743088 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.743068    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-723a1787-fr7qn"]
Jul 31 22:10:34.760982 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.760955    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da5db0e-408d-4987-99d7-1ca61a79f2b4" path="/var/lib/kubelet/pods/2da5db0e-408d-4987-99d7-1ca61a79f2b4/volumes"
Jul 31 22:10:34.803238 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.803200    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:34.862841 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.862807    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:10:34.871300 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.871280    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mf8s\" (UniqueName: \"kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s\") pod \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") "
Jul 31 22:10:34.871421 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.871340    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume\") pod \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\" (UID: \"faa5ab3c-2cc7-46f1-8635-94ced879b86b\") "
Jul 31 22:10:34.871719 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.871698    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "faa5ab3c-2cc7-46f1-8635-94ced879b86b" (UID: "faa5ab3c-2cc7-46f1-8635-94ced879b86b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:10:34.873220 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.873201    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s" (OuterVolumeSpecName: "kube-api-access-2mf8s") pod "faa5ab3c-2cc7-46f1-8635-94ced879b86b" (UID: "faa5ab3c-2cc7-46f1-8635-94ced879b86b"). InnerVolumeSpecName "kube-api-access-2mf8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:10:34.971995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.971970    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mf8s\" (UniqueName: \"kubernetes.io/projected/faa5ab3c-2cc7-46f1-8635-94ced879b86b-kube-api-access-2mf8s\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:10:34.971995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:34.971995    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/faa5ab3c-2cc7-46f1-8635-94ced879b86b-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:10:35.164153 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.164080    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:35.452249 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.452167    2568 generic.go:356] "Generic (PLEG): container finished" podID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" containerID="4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829" exitCode=0
Jul 31 22:10:35.452249 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.452211    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"
Jul 31 22:10:35.452413 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.452251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" event={"ID":"faa5ab3c-2cc7-46f1-8635-94ced879b86b","Type":"ContainerDied","Data":"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"}
Jul 31 22:10:35.452413 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.452308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc" event={"ID":"faa5ab3c-2cc7-46f1-8635-94ced879b86b","Type":"ContainerDied","Data":"6008c7e4f3e8dbf9064532d6840397361e124efc444cffde8daae4dd2ff87027"}
Jul 31 22:10:35.452413 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.452331    2568 scope.go:117] "RemoveContainer" containerID="4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"
Jul 31 22:10:35.462315 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.462300    2568 scope.go:117] "RemoveContainer" containerID="4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"
Jul 31 22:10:35.462568 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:10:35.462550    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829\": container with ID starting with 4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829 not found: ID does not exist" containerID="4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"
Jul 31 22:10:35.462626 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.462577    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829"} err="failed to get container status \"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829\": rpc error: code = NotFound desc = could not find container \"4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829\": container with ID starting with 4c9a19d7c87700c492f811116e6e825d242cb2896c2d93c7edbed103d82b2829 not found: ID does not exist"
Jul 31 22:10:35.476836 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.476797    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:10:35.483036 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:35.483017    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-723a1787-78b49ddb48-hstgc"]
Jul 31 22:10:36.757361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:36.757327    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" path="/var/lib/kubelet/pods/faa5ab3c-2cc7-46f1-8635-94ced879b86b/volumes"
Jul 31 22:10:40.989943 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:40.989908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.053275 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.053242    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.273703 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.273629    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.499732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.499703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.641992 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.641910    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.729466 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.729432    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:41.884711 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:41.884677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:47.662149 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:47.662103    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:47.732008 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:47.731971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:47.824418 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:47.824377    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:47.922924 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:47.922844    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:48.059315 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:48.059284    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:53.621396 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:53.621361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:10:53.690733 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:10:53.690703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:11:22.154644 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.154591    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 22:11:22.155134 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.154799    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" podUID="5cf4ee20-d194-4a47-880a-b215c6f838e6" containerName="manager" containerID="cri-o://8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046" gracePeriod=10
Jul 31 22:11:22.406186 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.406135    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 22:11:22.557035 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.557003    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz7b7\" (UniqueName: \"kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7\") pod \"5cf4ee20-d194-4a47-880a-b215c6f838e6\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") "
Jul 31 22:11:22.557166 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.557148    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume\") pod \"5cf4ee20-d194-4a47-880a-b215c6f838e6\" (UID: \"5cf4ee20-d194-4a47-880a-b215c6f838e6\") "
Jul 31 22:11:22.557575 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.557548    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cf4ee20-d194-4a47-880a-b215c6f838e6" (UID: "5cf4ee20-d194-4a47-880a-b215c6f838e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:11:22.558947 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.558923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7" (OuterVolumeSpecName: "kube-api-access-lz7b7") pod "5cf4ee20-d194-4a47-880a-b215c6f838e6" (UID: "5cf4ee20-d194-4a47-880a-b215c6f838e6"). InnerVolumeSpecName "kube-api-access-lz7b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:11:22.658686 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.658627    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cf4ee20-d194-4a47-880a-b215c6f838e6-extensions-socket-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:11:22.658686 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.658654    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz7b7\" (UniqueName: \"kubernetes.io/projected/5cf4ee20-d194-4a47-880a-b215c6f838e6-kube-api-access-lz7b7\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:11:22.738488 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.738449    2568 generic.go:356] "Generic (PLEG): container finished" podID="5cf4ee20-d194-4a47-880a-b215c6f838e6" containerID="8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046" exitCode=0
Jul 31 22:11:22.738576 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.738502    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"
Jul 31 22:11:22.738576 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.738507    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" event={"ID":"5cf4ee20-d194-4a47-880a-b215c6f838e6","Type":"ContainerDied","Data":"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"}
Jul 31 22:11:22.738673 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.738591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2" event={"ID":"5cf4ee20-d194-4a47-880a-b215c6f838e6","Type":"ContainerDied","Data":"c574728ae9c9215bb0a411ea3fc7becac0bc0fa7bc157942bd8edf921aa58be7"}
Jul 31 22:11:22.738673 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.738620    2568 scope.go:117] "RemoveContainer" containerID="8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"
Jul 31 22:11:22.750442 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.750424    2568 scope.go:117] "RemoveContainer" containerID="8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"
Jul 31 22:11:22.750753 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:11:22.750722    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046\": container with ID starting with 8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046 not found: ID does not exist" containerID="8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"
Jul 31 22:11:22.750862 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.750762    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046"} err="failed to get container status \"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046\": rpc error: code = NotFound desc = could not find container \"8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046\": container with ID starting with 8bf5b316e190e8d4ef347a3569600ca3756a831371dc695317d24157f287b046 not found: ID does not exist"
Jul 31 22:11:22.761070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.761046    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 22:11:22.764702 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:22.764680    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9cnm2"]
Jul 31 22:11:24.757773 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:11:24.757728    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf4ee20-d194-4a47-880a-b215c6f838e6" path="/var/lib/kubelet/pods/5cf4ee20-d194-4a47-880a-b215c6f838e6/volumes"
Jul 31 22:12:05.459363 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:05.459332    2568 scope.go:117] "RemoveContainer" containerID="1778eeb8aff70354963ad634a2fab2ab9c40e710a15e0b62cb1266736e5af539"
Jul 31 22:12:37.789263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789228    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"]
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789637    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da5db0e-408d-4987-99d7-1ca61a79f2b4" containerName="revoke-keys"
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789650    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da5db0e-408d-4987-99d7-1ca61a79f2b4" containerName="revoke-keys"
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789658    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" containerName="payload-pre-processing"
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789663    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" containerName="payload-pre-processing"
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789679    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf4ee20-d194-4a47-880a-b215c6f838e6" containerName="manager"
Jul 31 22:12:37.789728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789685    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf4ee20-d194-4a47-880a-b215c6f838e6" containerName="manager"
Jul 31 22:12:37.789979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789740    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf4ee20-d194-4a47-880a-b215c6f838e6" containerName="manager"
Jul 31 22:12:37.789979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789747    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da5db0e-408d-4987-99d7-1ca61a79f2b4" containerName="revoke-keys"
Jul 31 22:12:37.789979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.789755    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa5ab3c-2cc7-46f1-8635-94ced879b86b" containerName="payload-pre-processing"
Jul 31 22:12:37.792384 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.792368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:37.794789 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.794769    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7k9cd\""
Jul 31 22:12:37.804212 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.804187    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"]
Jul 31 22:12:37.927262 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.927232    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db671b35-2b37-4044-91ac-ecf701849392-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:37.927377 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:37.927295    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqp2\" (UniqueName: \"kubernetes.io/projected/db671b35-2b37-4044-91ac-ecf701849392-kube-api-access-8qqp2\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.028271 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.028245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db671b35-2b37-4044-91ac-ecf701849392-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.028372 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.028299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqp2\" (UniqueName: \"kubernetes.io/projected/db671b35-2b37-4044-91ac-ecf701849392-kube-api-access-8qqp2\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.028649 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.028632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db671b35-2b37-4044-91ac-ecf701849392-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.036935 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.036913    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqp2\" (UniqueName: \"kubernetes.io/projected/db671b35-2b37-4044-91ac-ecf701849392-kube-api-access-8qqp2\") pod \"kuadrant-operator-controller-manager-68cf589589-pklh8\" (UID: \"db671b35-2b37-4044-91ac-ecf701849392\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.103408 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.103351    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:38.239626 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:38.239602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"]
Jul 31 22:12:38.241658 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:12:38.241629    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb671b35_2b37_4044_91ac_ecf701849392.slice/crio-a9f86c5d937aad9c5ea0282de51671148328bd93ddf99a0413ae48d1d6adf10f WatchSource:0}: Error finding container a9f86c5d937aad9c5ea0282de51671148328bd93ddf99a0413ae48d1d6adf10f: Status 404 returned error can't find the container with id a9f86c5d937aad9c5ea0282de51671148328bd93ddf99a0413ae48d1d6adf10f
Jul 31 22:12:39.178752 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:39.178713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8" event={"ID":"db671b35-2b37-4044-91ac-ecf701849392","Type":"ContainerStarted","Data":"43b2f8243908b63f48fe8218da5305f23cb132841eae19f49722c1180f88597b"}
Jul 31 22:12:39.179143 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:39.178778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8" event={"ID":"db671b35-2b37-4044-91ac-ecf701849392","Type":"ContainerStarted","Data":"a9f86c5d937aad9c5ea0282de51671148328bd93ddf99a0413ae48d1d6adf10f"}
Jul 31 22:12:39.179143 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:39.178810    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:39.210088 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:39.210044    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8" podStartSLOduration=2.210029095 podStartE2EDuration="2.210029095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:12:39.208232241 +0000 UTC m=+2194.996565813" watchObservedRunningTime="2026-07-31 22:12:39.210029095 +0000 UTC m=+2194.998362667"
Jul 31 22:12:50.187513 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:50.187482    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-pklh8"
Jul 31 22:12:56.739438 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:56.739402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:12:57.025054 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:57.024975    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:12:57.434085 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:57.434005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:12:59.850289 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:59.850259    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:12:59.950077 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:12:59.950041    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:00.962439 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:00.962411    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:01.438951 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.438895    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:01.534969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.534940    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:01.608480 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.608445    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:13:01.610714 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.610691    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:01.612188 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.612167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.614514 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.614492    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b0a39ff7-dockercfg-wj4v8\""
Jul 31 22:13:01.614514 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.614507    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b0a39ff7\""
Jul 31 22:13:01.620917 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.620894    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:13:01.646603 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.646563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.646759 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.646715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shvrh\" (UniqueName: \"kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.747554 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.747522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shvrh\" (UniqueName: \"kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.747739 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.747634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.748315 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.748295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.755373 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.755348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shvrh\" (UniqueName: \"kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh\") pod \"payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:01.925335 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:01.925307    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:02.061293 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:02.061270    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:13:02.063675 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:13:02.063645    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6faa688_24a0_41e9_abbd_6cdcee06f43c.slice/crio-512d7ae71b0f68b20102923c5d85f88c2bd4a0502aef974ad85387fe75b6a91b WatchSource:0}: Error finding container 512d7ae71b0f68b20102923c5d85f88c2bd4a0502aef974ad85387fe75b6a91b: Status 404 returned error can't find the container with id 512d7ae71b0f68b20102923c5d85f88c2bd4a0502aef974ad85387fe75b6a91b
Jul 31 22:13:02.320292 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:02.320214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" event={"ID":"c6faa688-24a0-41e9-abbd-6cdcee06f43c","Type":"ContainerStarted","Data":"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"}
Jul 31 22:13:02.320292 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:02.320277    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" event={"ID":"c6faa688-24a0-41e9-abbd-6cdcee06f43c","Type":"ContainerStarted","Data":"512d7ae71b0f68b20102923c5d85f88c2bd4a0502aef974ad85387fe75b6a91b"}
Jul 31 22:13:02.320452 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:02.320309    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:02.337224 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:02.337178    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" podStartSLOduration=1.337161944 podStartE2EDuration="1.337161944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:13:02.335180493 +0000 UTC m=+2218.123514066" watchObservedRunningTime="2026-07-31 22:13:02.337161944 +0000 UTC m=+2218.125495520"
Jul 31 22:13:05.484035 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:05.484001    2568 scope.go:117] "RemoveContainer" containerID="a3b5959aa81a614745375672f6655b11e54ce5d2c25541a1f292d2cb0febc00a"
Jul 31 22:13:13.328505 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:13.328474    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:13:24.760279 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:24.760234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:27.049975 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:27.049868    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:13:59.343798 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.343757    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"]
Jul 31 22:13:59.347500 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.347483    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:13:59.349822 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.349794    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:13:59.353681 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.353655    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"]
Jul 31 22:13:59.460203 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.460171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx\" (UID: \"dba51b77-4f5a-477f-b576-213d15a5145f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:13:59.561382 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.561350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx\" (UID: \"dba51b77-4f5a-477f-b576-213d15a5145f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:13:59.561974 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.561956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx\" (UID: \"dba51b77-4f5a-477f-b576-213d15a5145f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:13:59.660327 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.660266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:13:59.795553 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:13:59.795526    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"]
Jul 31 22:13:59.797574 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:13:59.797549    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba51b77_4f5a_477f_b576_213d15a5145f.slice/crio-c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800 WatchSource:0}: Error finding container c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800: Status 404 returned error can't find the container with id c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800
Jul 31 22:14:00.664359 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:00.664287    2568 generic.go:356] "Generic (PLEG): container finished" podID="dba51b77-4f5a-477f-b576-213d15a5145f" containerID="3140ee3558bf7380a00a6f72024f9fe964e995396c13dfcc4fdb994ed7fc415c" exitCode=0
Jul 31 22:14:00.664685 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:00.664379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx" event={"ID":"dba51b77-4f5a-477f-b576-213d15a5145f","Type":"ContainerDied","Data":"3140ee3558bf7380a00a6f72024f9fe964e995396c13dfcc4fdb994ed7fc415c"}
Jul 31 22:14:00.664685 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:00.664481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx" event={"ID":"dba51b77-4f5a-477f-b576-213d15a5145f","Type":"ContainerStarted","Data":"c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800"}
Jul 31 22:14:01.804707 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:01.804682    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:14:01.883668 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:01.883638    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca\") pod \"dba51b77-4f5a-477f-b576-213d15a5145f\" (UID: \"dba51b77-4f5a-477f-b576-213d15a5145f\") "
Jul 31 22:14:01.884109 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:01.884081    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dba51b77-4f5a-477f-b576-213d15a5145f" (UID: "dba51b77-4f5a-477f-b576-213d15a5145f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:14:01.984750 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:01.984680    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba51b77-4f5a-477f-b576-213d15a5145f-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:14:02.678783 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:02.678754    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"
Jul 31 22:14:02.678969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:02.678755    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx" event={"ID":"dba51b77-4f5a-477f-b576-213d15a5145f","Type":"ContainerDied","Data":"c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800"}
Jul 31 22:14:02.678969 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:02.678884    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1cad3b1682f81ad6e76744d4e0b7236f9f5829f763318107406968853149800"
Jul 31 22:14:05.506696 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:05.506658    2568 scope.go:117] "RemoveContainer" containerID="88f6b376e65c73df1e1d8ed4547b619951e8fffbf65f9f6aeca47d7a69431724"
Jul 31 22:14:05.515834 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:05.515800    2568 scope.go:117] "RemoveContainer" containerID="492eba0b176f6cf5cc5c1cce174e4f7c173b134f1385e75c4a0bb758ce2940a1"
Jul 31 22:14:13.237018 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:13.236986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:14.976642 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:14.976600    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:15.019294 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.019262    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:14:15.079244 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.079210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:15.161238 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.161205    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"]
Jul 31 22:14:15.163403 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.163369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:15.164993 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.164973    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b0a39ff7-pzqgx"]
Jul 31 22:14:15.225449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.225413    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:15.759517 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:15.759462    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" podUID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" containerName="payload-pre-processing" containerID="cri-o://b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449" gracePeriod=30
Jul 31 22:14:16.019965 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.019913    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:14:16.115737 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.115713    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shvrh\" (UniqueName: \"kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh\") pod \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") "
Jul 31 22:14:16.115908 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.115808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume\") pod \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\" (UID: \"c6faa688-24a0-41e9-abbd-6cdcee06f43c\") "
Jul 31 22:14:16.116208 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.116182    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6faa688-24a0-41e9-abbd-6cdcee06f43c" (UID: "c6faa688-24a0-41e9-abbd-6cdcee06f43c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:14:16.117736 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.117714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh" (OuterVolumeSpecName: "kube-api-access-shvrh") pod "c6faa688-24a0-41e9-abbd-6cdcee06f43c" (UID: "c6faa688-24a0-41e9-abbd-6cdcee06f43c"). InnerVolumeSpecName "kube-api-access-shvrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:14:16.217464 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.217438    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shvrh\" (UniqueName: \"kubernetes.io/projected/c6faa688-24a0-41e9-abbd-6cdcee06f43c-kube-api-access-shvrh\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:14:16.217464 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.217462    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6faa688-24a0-41e9-abbd-6cdcee06f43c-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:14:16.757550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.757515    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dba51b77-4f5a-477f-b576-213d15a5145f" path="/var/lib/kubelet/pods/dba51b77-4f5a-477f-b576-213d15a5145f/volumes"
Jul 31 22:14:16.765857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.765476    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" containerID="b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449" exitCode=0
Jul 31 22:14:16.765857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.765524    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"
Jul 31 22:14:16.765857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.765548    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" event={"ID":"c6faa688-24a0-41e9-abbd-6cdcee06f43c","Type":"ContainerDied","Data":"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"}
Jul 31 22:14:16.765857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.765604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52" event={"ID":"c6faa688-24a0-41e9-abbd-6cdcee06f43c","Type":"ContainerDied","Data":"512d7ae71b0f68b20102923c5d85f88c2bd4a0502aef974ad85387fe75b6a91b"}
Jul 31 22:14:16.765857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.765638    2568 scope.go:117] "RemoveContainer" containerID="b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"
Jul 31 22:14:16.775732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.775706    2568 scope.go:117] "RemoveContainer" containerID="b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"
Jul 31 22:14:16.776055 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:14:16.776031    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449\": container with ID starting with b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449 not found: ID does not exist" containerID="b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"
Jul 31 22:14:16.776127 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.776069    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449"} err="failed to get container status \"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449\": rpc error: code = NotFound desc = could not find container \"b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449\": container with ID starting with b47f5b68282b4a8ae987a58341c4ec23b678fcccc46e859f9f8c609559053449 not found: ID does not exist"
Jul 31 22:14:16.782468 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.782443    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:14:16.786045 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:16.786026    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b0a39ff7-6c7c4c4868-rpl52"]
Jul 31 22:14:18.352121 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:18.352085    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:18.757163 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:18.757132    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" path="/var/lib/kubelet/pods/c6faa688-24a0-41e9-abbd-6cdcee06f43c/volumes"
Jul 31 22:14:23.435035 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:23.434998    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:14:59.487466 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:14:59.487431    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:00.138379 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138336    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"]
Jul 31 22:15:00.138757 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138744    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" containerName="payload-pre-processing"
Jul 31 22:15:00.138804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138760    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" containerName="payload-pre-processing"
Jul 31 22:15:00.138804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138782    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dba51b77-4f5a-477f-b576-213d15a5145f" containerName="revoke-keys"
Jul 31 22:15:00.138804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138788    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dba51b77-4f5a-477f-b576-213d15a5145f" containerName="revoke-keys"
Jul 31 22:15:00.138978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138871    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dba51b77-4f5a-477f-b576-213d15a5145f" containerName="revoke-keys"
Jul 31 22:15:00.138978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.138884    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6faa688-24a0-41e9-abbd-6cdcee06f43c" containerName="payload-pre-processing"
Jul 31 22:15:00.142125 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.142110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"
Jul 31 22:15:00.144057 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.144033    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:15:00.149345 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.149323    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"]
Jul 31 22:15:00.154052 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.154031    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"
Jul 31 22:15:00.296646 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.296611    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"]
Jul 31 22:15:00.297464 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:15:00.297425    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16393f8f_5634_498e_9ac6_c78a0bd4371e.slice/crio-5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2 WatchSource:0}: Error finding container 5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2: Status 404 returned error can't find the container with id 5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2
Jul 31 22:15:00.622590 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:00.622544    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:01.024984 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:01.024941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp" event={"ID":"16393f8f-5634-498e-9ac6-c78a0bd4371e","Type":"ContainerStarted","Data":"d6eeead078cf29a0381ab641ba08113e91ef6ccf8a63d9f1354a919898760a2f"}
Jul 31 22:15:01.025176 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:01.024998    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp" event={"ID":"16393f8f-5634-498e-9ac6-c78a0bd4371e","Type":"ContainerStarted","Data":"5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2"}
Jul 31 22:15:01.040732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:01.040687    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp" podStartSLOduration=1.040673586 podStartE2EDuration="1.040673586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:15:01.038003575 +0000 UTC m=+2336.826337149" watchObservedRunningTime="2026-07-31 22:15:01.040673586 +0000 UTC m=+2336.829007158"
Jul 31 22:15:02.031763 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:02.031723    2568 generic.go:356] "Generic (PLEG): container finished" podID="16393f8f-5634-498e-9ac6-c78a0bd4371e" containerID="d6eeead078cf29a0381ab641ba08113e91ef6ccf8a63d9f1354a919898760a2f" exitCode=0
Jul 31 22:15:02.032202 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:02.031806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp" event={"ID":"16393f8f-5634-498e-9ac6-c78a0bd4371e","Type":"ContainerDied","Data":"d6eeead078cf29a0381ab641ba08113e91ef6ccf8a63d9f1354a919898760a2f"}
Jul 31 22:15:03.172636 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:03.172614    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"
Jul 31 22:15:04.045721 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:04.045683    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp"
Jul 31 22:15:04.046010 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:04.045715    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758935-67hrp" event={"ID":"16393f8f-5634-498e-9ac6-c78a0bd4371e","Type":"ContainerDied","Data":"5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2"}
Jul 31 22:15:04.046010 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:04.045770    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b6a0e3b40d08b1c89b65d4e5accdd795d77944a36e71d1c527c8cf9d559a5d2"
Jul 31 22:15:06.049417 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:06.049365    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:06.109776 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:06.109743    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:06.337210 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:06.337133    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:06.559128 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:06.559095    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:17.852259 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:17.852225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:17.950779 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:17.950752    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:18.051804 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:18.051778    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:18.685222 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:18.685186    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:18.784480 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:18.784446    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:18.887955 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:18.887926    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:20.155778 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:20.155741    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:26.124513 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:26.124472    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:26.224296 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:26.224266    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:26.793836 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:26.793790    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:33.008388 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:33.008354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:33.112349 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:33.112319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:33.208949 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:33.208917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:43.713055 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:43.713015    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:15:43.945341 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:15:43.945311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:04.963458 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:04.963422    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:10.778739 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:10.778703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:10.838841 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:10.838784    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:11.153590 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:11.153495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:11.467875 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:11.467747    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:11.623125 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:11.623090    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:14.707544 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:14.707511    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:14.808920 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:14.808883    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:15.842163 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:15.842129    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:15.962832 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:15.962770    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:16.351091 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.351056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:16.450960 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.450917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:16.469921 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.469890    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:16:16.470641 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.470614    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16393f8f-5634-498e-9ac6-c78a0bd4371e" containerName="cleanup"
Jul 31 22:16:16.470641 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.470642    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="16393f8f-5634-498e-9ac6-c78a0bd4371e" containerName="cleanup"
Jul 31 22:16:16.470846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.470758    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="16393f8f-5634-498e-9ac6-c78a0bd4371e" containerName="cleanup"
Jul 31 22:16:16.474299 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.474280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.477276 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.477256    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-0ac91e\""
Jul 31 22:16:16.477377 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.477255    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-0ac91e-dockercfg-k6hkn\""
Jul 31 22:16:16.490126 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.490106    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:16:16.594180 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.594142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.594377 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.594303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs6gv\" (UniqueName: \"kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.695647 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.695576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.695647 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.695636    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs6gv\" (UniqueName: \"kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.696256 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.696237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.703234 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.703213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs6gv\" (UniqueName: \"kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv\") pod \"payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.785488 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.785468    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:16.922809 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:16.922775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:16:16.924151 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:16:16.924123    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd500e59_12c5_4cf8_9174_100c85759a8d.slice/crio-48ac93ff9a0c05ca9ed102190ffa79174b5ebb37c38f2c391725103044c7dfda WatchSource:0}: Error finding container 48ac93ff9a0c05ca9ed102190ffa79174b5ebb37c38f2c391725103044c7dfda: Status 404 returned error can't find the container with id 48ac93ff9a0c05ca9ed102190ffa79174b5ebb37c38f2c391725103044c7dfda
Jul 31 22:16:17.466561 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:17.466524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" event={"ID":"fd500e59-12c5-4cf8-9174-100c85759a8d","Type":"ContainerStarted","Data":"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"}
Jul 31 22:16:17.466744 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:17.466580    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" event={"ID":"fd500e59-12c5-4cf8-9174-100c85759a8d","Type":"ContainerStarted","Data":"48ac93ff9a0c05ca9ed102190ffa79174b5ebb37c38f2c391725103044c7dfda"}
Jul 31 22:16:17.466744 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:17.466660    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:17.482212 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:17.482142    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" podStartSLOduration=1.482128559 podStartE2EDuration="1.482128559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:16:17.480137162 +0000 UTC m=+2413.268470735" watchObservedRunningTime="2026-07-31 22:16:17.482128559 +0000 UTC m=+2413.270462132"
Jul 31 22:16:28.476893 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:28.476788    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:16:39.808675 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:39.808631    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:40.137273 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.137171    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:40.282598 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.282569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:40.502512 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.502479    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:16:40.506326 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.506306    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.508345 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.508323    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d0110c-openshift-default-dockercfg-jfzn5\""
Jul 31 22:16:40.516809 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.516787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:16:40.528853 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.528810    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269kb\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601392    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601446    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.601894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.601510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.656090 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.656064    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:40.702852 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.702804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.702986 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.702866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.702986 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.702899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.702986 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.702956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703150 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.702988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703150 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269kb\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703150 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703302 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703169    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703302 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703241    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703433 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703404    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703586 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703658 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703901 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.703979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.703888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.705254 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.705229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.705461 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.705446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.711756 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.711706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.712391 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.712368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-269kb\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb\") pod \"e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") " pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.817230 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.817170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:40.957341 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.957283    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:16:40.959828 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:16:40.959791    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996ba0e6_fdb3_4548_9f54_e38a146c4cb9.slice/crio-1182f7d46ecb6de8a74c31fb5d94c10339d1e80dc894e968511356b65b7eab0b WatchSource:0}: Error finding container 1182f7d46ecb6de8a74c31fb5d94c10339d1e80dc894e968511356b65b7eab0b: Status 404 returned error can't find the container with id 1182f7d46ecb6de8a74c31fb5d94c10339d1e80dc894e968511356b65b7eab0b
Jul 31 22:16:40.962305 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.962277    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:40.962392 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.962339    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:40.962392 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:40.962373    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:41.619445 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:41.619410    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerStarted","Data":"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"}
Jul 31 22:16:41.619633 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:41.619473    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerStarted","Data":"1182f7d46ecb6de8a74c31fb5d94c10339d1e80dc894e968511356b65b7eab0b"}
Jul 31 22:16:41.639335 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:41.639291    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podStartSLOduration=1.639276484 podStartE2EDuration="1.639276484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:16:41.636519093 +0000 UTC m=+2437.424852665" watchObservedRunningTime="2026-07-31 22:16:41.639276484 +0000 UTC m=+2437.427610056"
Jul 31 22:16:41.818196 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:41.818165    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:42.822682 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:42.822655    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:43.630758 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:43.630721    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:43.631613 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:43.631592    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:43.634828 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:43.634789    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:43.732629 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:43.732598    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:44.776869 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:44.776811    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:45.069780 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:45.069698    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:45.270108 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:45.270074    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:45.364378 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:45.364305    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:16:57.724531 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.724502    2568 generic.go:356] "Generic (PLEG): container finished" podID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerID="6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8" exitCode=0
Jul 31 22:16:57.724922 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.724547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerDied","Data":"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"}
Jul 31 22:16:57.724922 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.724905    2568 scope.go:117] "RemoveContainer" containerID="6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"
Jul 31 22:16:57.725850 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.725801    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:57.725942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.725890    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:57.725942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:57.725921    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:16:58.631138 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:58.631108    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:58.732494 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:58.732459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerStarted","Data":"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"}
Jul 31 22:16:58.817448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:58.817356    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:16:58.818665 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:58.818637    2568 patch_prober.go:28] interesting pod/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 31 22:16:58.818789 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:58.818717    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 31 22:16:59.817973 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:59.817933    2568 patch_prober.go:28] interesting pod/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 31 22:16:59.818440 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:16:59.817995    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 31 22:17:00.817777 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:00.817741    2568 patch_prober.go:28] interesting pod/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 31 22:17:00.817966 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:00.817791    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 31 22:17:01.817574 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:01.817542    2568 patch_prober.go:28] interesting pod/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 31 22:17:01.817962 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:01.817621    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 31 22:17:02.818416 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:02.818384    2568 patch_prober.go:28] interesting pod/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 31 22:17:02.818785 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:02.818450    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 31 22:17:03.822269 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:03.822235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:17:03.822675 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:03.822613    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:17:03.823407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:03.823390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:17:05.562141 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:05.562107    2568 scope.go:117] "RemoveContainer" containerID="a219aa1aed942fa9f987740c7e202e15b75f8bc0743e013e33eaba8a53c19a7f"
Jul 31 22:17:06.337753 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:06.337714    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:17:08.760019 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:08.759969    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:17:24.414739 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:24.414707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:17:46.845660 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:46.845618    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:17:53.814202 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:17:53.814167    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:28.781160 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:28.781119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:29.670286 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.670237    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:29.795658 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.795622    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"]
Jul 31 22:18:29.799238 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.799222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:29.801336 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.801317    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:18:29.807905 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.807884    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"]
Jul 31 22:18:29.875272 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.875243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v\" (UID: \"87cd4dd5-5026-4094-85b7-b5efe78b8668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:29.976134 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.976075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v\" (UID: \"87cd4dd5-5026-4094-85b7-b5efe78b8668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:29.976626 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:29.976605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v\" (UID: \"87cd4dd5-5026-4094-85b7-b5efe78b8668\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:30.111039 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:30.111012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:30.246689 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:30.246661    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"]
Jul 31 22:18:30.248764 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:18:30.248740    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cd4dd5_5026_4094_85b7_b5efe78b8668.slice/crio-ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161 WatchSource:0}: Error finding container ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161: Status 404 returned error can't find the container with id ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161
Jul 31 22:18:30.273793 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:30.273761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v" event={"ID":"87cd4dd5-5026-4094-85b7-b5efe78b8668","Type":"ContainerStarted","Data":"ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161"}
Jul 31 22:18:31.281357 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:31.281323    2568 generic.go:356] "Generic (PLEG): container finished" podID="87cd4dd5-5026-4094-85b7-b5efe78b8668" containerID="5992540b8dbf2a1855b4d1915a40bd1e59f7165debcc15fa31fa0d54ab9111d5" exitCode=0
Jul 31 22:18:31.281752 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:31.281411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v" event={"ID":"87cd4dd5-5026-4094-85b7-b5efe78b8668","Type":"ContainerDied","Data":"5992540b8dbf2a1855b4d1915a40bd1e59f7165debcc15fa31fa0d54ab9111d5"}
Jul 31 22:18:32.431333 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:32.431309    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:32.499446 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:32.499409    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca\") pod \"87cd4dd5-5026-4094-85b7-b5efe78b8668\" (UID: \"87cd4dd5-5026-4094-85b7-b5efe78b8668\") "
Jul 31 22:18:32.500231 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:32.500199    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87cd4dd5-5026-4094-85b7-b5efe78b8668" (UID: "87cd4dd5-5026-4094-85b7-b5efe78b8668"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:18:32.600318 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:32.600255    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87cd4dd5-5026-4094-85b7-b5efe78b8668-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:18:33.295294 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:33.295266    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"
Jul 31 22:18:33.295449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:33.295313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v" event={"ID":"87cd4dd5-5026-4094-85b7-b5efe78b8668","Type":"ContainerDied","Data":"ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161"}
Jul 31 22:18:33.295449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:33.295366    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae930e9539a7d9eb0893f1da2f2bce674c7c48d3565efaa57a405568559f7161"
Jul 31 22:18:40.416928 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.416891    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:40.445317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.445281    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:18:40.445561 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.445537    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" podUID="fd500e59-12c5-4cf8-9174-100c85759a8d" containerName="payload-processing" containerID="cri-o://3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3" gracePeriod=30
Jul 31 22:18:40.515349 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.515311    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:40.599978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.599931    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"]
Jul 31 22:18:40.601125 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.601098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:40.603027 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.603004    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0ac91e-jfp4v"]
Jul 31 22:18:40.662137 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.662104    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:40.712867 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.712839    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:18:40.758281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.758243    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87cd4dd5-5026-4094-85b7-b5efe78b8668" path="/var/lib/kubelet/pods/87cd4dd5-5026-4094-85b7-b5efe78b8668/volumes"
Jul 31 22:18:40.880674 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.880646    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume\") pod \"fd500e59-12c5-4cf8-9174-100c85759a8d\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") "
Jul 31 22:18:40.880834 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.880682    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs6gv\" (UniqueName: \"kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv\") pod \"fd500e59-12c5-4cf8-9174-100c85759a8d\" (UID: \"fd500e59-12c5-4cf8-9174-100c85759a8d\") "
Jul 31 22:18:40.881097 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.881073    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd500e59-12c5-4cf8-9174-100c85759a8d" (UID: "fd500e59-12c5-4cf8-9174-100c85759a8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:18:40.882790 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.882764    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv" (OuterVolumeSpecName: "kube-api-access-rs6gv") pod "fd500e59-12c5-4cf8-9174-100c85759a8d" (UID: "fd500e59-12c5-4cf8-9174-100c85759a8d"). InnerVolumeSpecName "kube-api-access-rs6gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:18:40.982454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.982369    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500e59-12c5-4cf8-9174-100c85759a8d-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:18:40.982454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.982405    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs6gv\" (UniqueName: \"kubernetes.io/projected/fd500e59-12c5-4cf8-9174-100c85759a8d-kube-api-access-rs6gv\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:18:40.990172 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:40.990145    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:41.341885 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.341850    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd500e59-12c5-4cf8-9174-100c85759a8d" containerID="3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3" exitCode=0
Jul 31 22:18:41.342068 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.341968    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"
Jul 31 22:18:41.342068 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.341991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" event={"ID":"fd500e59-12c5-4cf8-9174-100c85759a8d","Type":"ContainerDied","Data":"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"}
Jul 31 22:18:41.342068 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.342045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f" event={"ID":"fd500e59-12c5-4cf8-9174-100c85759a8d","Type":"ContainerDied","Data":"48ac93ff9a0c05ca9ed102190ffa79174b5ebb37c38f2c391725103044c7dfda"}
Jul 31 22:18:41.342170 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.342070    2568 scope.go:117] "RemoveContainer" containerID="3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"
Jul 31 22:18:41.352109 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.352091    2568 scope.go:117] "RemoveContainer" containerID="3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"
Jul 31 22:18:41.352384 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:18:41.352365    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3\": container with ID starting with 3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3 not found: ID does not exist" containerID="3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"
Jul 31 22:18:41.352446 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.352392    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3"} err="failed to get container status \"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3\": rpc error: code = NotFound desc = could not find container \"3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3\": container with ID starting with 3ff6cd4753841d3fceecab5c8217217a639cda097897f97297e7e239c67451d3 not found: ID does not exist"
Jul 31 22:18:41.363794 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.363769    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:18:41.368893 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:41.368871    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-0ac91e-6dfd5f9b4-mm88f"]
Jul 31 22:18:42.757249 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:42.757209    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd500e59-12c5-4cf8-9174-100c85759a8d" path="/var/lib/kubelet/pods/fd500e59-12c5-4cf8-9174-100c85759a8d/volumes"
Jul 31 22:18:46.859186 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:46.859137    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:46.927503 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:46.927470    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:47.155263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.155180    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:47.379648 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.379614    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:47.494845 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.494790    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"]
Jul 31 22:18:47.495228 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495215    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd500e59-12c5-4cf8-9174-100c85759a8d" containerName="payload-processing"
Jul 31 22:18:47.495283 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495229    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd500e59-12c5-4cf8-9174-100c85759a8d" containerName="payload-processing"
Jul 31 22:18:47.495283 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495255    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cd4dd5-5026-4094-85b7-b5efe78b8668" containerName="revoke-keys"
Jul 31 22:18:47.495283 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495261    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cd4dd5-5026-4094-85b7-b5efe78b8668" containerName="revoke-keys"
Jul 31 22:18:47.495385 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495330    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd500e59-12c5-4cf8-9174-100c85759a8d" containerName="payload-processing"
Jul 31 22:18:47.495385 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.495339    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cd4dd5-5026-4094-85b7-b5efe78b8668" containerName="revoke-keys"
Jul 31 22:18:47.498614 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.498590    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:47.500918 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.500894    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:18:47.505345 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.505317    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"]
Jul 31 22:18:47.653960 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.653921    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7\" (UID: \"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:47.755282 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.755177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7\" (UID: \"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:47.755874 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.755849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7\" (UID: \"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:47.810984 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.810946    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:47.953470 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:47.953444    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"]
Jul 31 22:18:47.955005 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:18:47.954978    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c51d5b_0bbb_4b16_8cc0_6e9d5ac44a09.slice/crio-0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0 WatchSource:0}: Error finding container 0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0: Status 404 returned error can't find the container with id 0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0
Jul 31 22:18:48.392648 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:48.392610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7" event={"ID":"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09","Type":"ContainerStarted","Data":"4abeab232bbacc22e86409393a3eda1180fb9d2474614ca93025b0f37c0f3eaa"}
Jul 31 22:18:48.392805 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:48.392670    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7" event={"ID":"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09","Type":"ContainerStarted","Data":"0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0"}
Jul 31 22:18:48.412076 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:48.412009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7" podStartSLOduration=1.411985462 podStartE2EDuration="1.411985462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:18:48.408751413 +0000 UTC m=+2564.197084986" watchObservedRunningTime="2026-07-31 22:18:48.411985462 +0000 UTC m=+2564.200319036"
Jul 31 22:18:49.399997 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:49.399961    2568 generic.go:356] "Generic (PLEG): container finished" podID="81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" containerID="4abeab232bbacc22e86409393a3eda1180fb9d2474614ca93025b0f37c0f3eaa" exitCode=0
Jul 31 22:18:49.400430 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:49.400046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7" event={"ID":"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09","Type":"ContainerDied","Data":"4abeab232bbacc22e86409393a3eda1180fb9d2474614ca93025b0f37c0f3eaa"}
Jul 31 22:18:50.545416 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:50.545395    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:50.579758 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:50.579735    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca\") pod \"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09\" (UID: \"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09\") "
Jul 31 22:18:50.580186 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:50.580153    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" (UID: "81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:18:50.680537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:50.680480    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:18:51.412897 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:51.412871    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"
Jul 31 22:18:51.413056 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:51.412908    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7" event={"ID":"81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09","Type":"ContainerDied","Data":"0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0"}
Jul 31 22:18:51.413056 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:51.412954    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fdfae320420a54165d887d08855976a7e1203fc00cf141b86133d73416690d0"
Jul 31 22:18:58.160261 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.160205    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:58.234136 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.234089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:58.292958 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.292930    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:58.342162 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.342130    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"]
Jul 31 22:18:58.344575 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.344557    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d0110c-48tt7"]
Jul 31 22:18:58.361333 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.361301    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:58.703033 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.702992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:18:58.757059 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:18:58.756991    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" path="/var/lib/kubelet/pods/81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09/volumes"
Jul 31 22:19:04.470445 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.470400    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:04.525070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.525039    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:04.716389 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.716354    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:19:04.716650 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.716608    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy" containerID="cri-o://b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc" gracePeriod=30
Jul 31 22:19:04.742332 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.742308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:04.960949 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:04.960921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:05.323916 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:05.323856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:05.634940 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:05.634911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:05.766273 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:05.766234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:08.555575 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:08.555509    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:08.642669 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:08.642597    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:09.677061 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:09.677032    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:09.884860 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:09.884474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:09.971580 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:09.971559    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:19:10.056278 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056400 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056299    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-269kb\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056400 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056330    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056400 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056364    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056543 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056475    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056543 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056543 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056708 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056560    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056708 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:19:10.056708 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056632    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs\") pod \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\" (UID: \"996ba0e6-fdb3-4548-9f54-e38a146c4cb9\") "
Jul 31 22:19:10.056910 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056797    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:19:10.056910 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.056850    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:19:10.057073 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.057041    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:19:10.057073 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.057062    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:19:10.057215 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.057082    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-credential-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.057215 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.057102    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-data\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.057215 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.057115    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-certs\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.058368 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.058335    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:19:10.058561 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.058538    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb" (OuterVolumeSpecName: "kube-api-access-269kb") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "kube-api-access-269kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:19:10.058669 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.058609    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:19:10.058751 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.058732    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "996ba0e6-fdb3-4548-9f54-e38a146c4cb9" (UID: "996ba0e6-fdb3-4548-9f54-e38a146c4cb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:19:10.157573 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157552    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-envoy\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.157573 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157572    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-269kb\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-kube-api-access-269kb\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.157738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157582    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-token\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.157738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157590    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istio-podinfo\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.157738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157598    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-istiod-ca-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.157738 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.157606    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/996ba0e6-fdb3-4548-9f54-e38a146c4cb9-workload-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:19:10.257095 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.257058    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:10.357237 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.357200    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:10.529635 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.529548    2568 generic.go:356] "Generic (PLEG): container finished" podID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerID="b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc" exitCode=0
Jul 31 22:19:10.529635 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.529623    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"
Jul 31 22:19:10.529844 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.529631    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerDied","Data":"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"}
Jul 31 22:19:10.529844 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.529714    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc" event={"ID":"996ba0e6-fdb3-4548-9f54-e38a146c4cb9","Type":"ContainerDied","Data":"1182f7d46ecb6de8a74c31fb5d94c10339d1e80dc894e968511356b65b7eab0b"}
Jul 31 22:19:10.529844 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.529736    2568 scope.go:117] "RemoveContainer" containerID="b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"
Jul 31 22:19:10.539789 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.539772    2568 scope.go:117] "RemoveContainer" containerID="6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"
Jul 31 22:19:10.548513 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.548496    2568 scope.go:117] "RemoveContainer" containerID="b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"
Jul 31 22:19:10.548784 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:19:10.548766    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc\": container with ID starting with b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc not found: ID does not exist" containerID="b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"
Jul 31 22:19:10.548855 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.548791    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc"} err="failed to get container status \"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc\": rpc error: code = NotFound desc = could not find container \"b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc\": container with ID starting with b741fe49f18d9ac6db988882c9953e54c72af8286130c7895d82ae9d451fc5dc not found: ID does not exist"
Jul 31 22:19:10.548855 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.548824    2568 scope.go:117] "RemoveContainer" containerID="6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"
Jul 31 22:19:10.549357 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:19:10.549268    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8\": container with ID starting with 6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8 not found: ID does not exist" containerID="6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"
Jul 31 22:19:10.549357 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.549299    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8"} err="failed to get container status \"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8\": rpc error: code = NotFound desc = could not find container \"6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8\": container with ID starting with 6fc4a89faf55e8a17fe14b28d4f889e29dbd23db922d8afe346b70a3297ad0a8 not found: ID does not exist"
Jul 31 22:19:10.552138 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.552114    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:19:10.558036 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.558017    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d0110c-openshift-default-6746b9dfd-jxpmc"]
Jul 31 22:19:10.757705 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:10.757680    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" path="/var/lib/kubelet/pods/996ba0e6-fdb3-4548-9f54-e38a146c4cb9/volumes"
Jul 31 22:19:33.530339 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:33.530217    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:34.007799 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.007764    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:34.284622 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.284537    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:19:34.285228 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285198    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:19:34.285228 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285232    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:19:34.285324 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285258    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" containerName="revoke-keys"
Jul 31 22:19:34.285324 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285269    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" containerName="revoke-keys"
Jul 31 22:19:34.285398 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285387    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:19:34.285434 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285402    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="81c51d5b-0bbb-4b16-8cc0-6e9d5ac44a09" containerName="revoke-keys"
Jul 31 22:19:34.285434 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.285414    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:19:34.289320 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.289297    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.293103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.293079    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d193d8-openshift-default-dockercfg-fb6kd\""
Jul 31 22:19:34.298891 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.298867    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:19:34.311399 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.311364    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:34.471981 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.471946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.471981 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.471989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472014    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4xq2\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472281 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472261    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.472546 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.472335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.481906 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.481873    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:34.573854 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573725    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4xq2\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.573854 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.573854 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.573854 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.573936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574842 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574546    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574842 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.574842 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.574763    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.576277 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.576261    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.576518 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.576489    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.595641 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.595607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4xq2\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.597509 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.597485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token\") pod \"e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") " pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.600509 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.600478    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:34.745730 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.745703    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:19:34.747462 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:19:34.747438    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b8715b_34eb_4df4_92e6_a707f75bc08e.slice/crio-2a09c34783bd706990efee710b778bb4147de5c0949428ca53b723ce70c2a9ec WatchSource:0}: Error finding container 2a09c34783bd706990efee710b778bb4147de5c0949428ca53b723ce70c2a9ec: Status 404 returned error can't find the container with id 2a09c34783bd706990efee710b778bb4147de5c0949428ca53b723ce70c2a9ec
Jul 31 22:19:34.749691 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.749661    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:34.749798 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.749737    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:34.749798 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:34.749783    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:35.683982 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:35.683937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerStarted","Data":"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"}
Jul 31 22:19:35.684507 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:35.684009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerStarted","Data":"2a09c34783bd706990efee710b778bb4147de5c0949428ca53b723ce70c2a9ec"}
Jul 31 22:19:35.705548 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:35.705491    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podStartSLOduration=1.705471704 podStartE2EDuration="1.705471704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:19:35.702231531 +0000 UTC m=+2611.490565105" watchObservedRunningTime="2026-07-31 22:19:35.705471704 +0000 UTC m=+2611.493805277"
Jul 31 22:19:36.601209 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:36.601179    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:36.606625 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:36.606599    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:36.692089 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:36.692040    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:36.693526 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:36.693501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:37.641011 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:37.640976    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:37.743807 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:37.743776    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:38.770406 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:38.770339    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:39.114262 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:39.114164    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:39.260047 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:39.260012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:39.356694 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:39.356660    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:50.741545 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:50.741498    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:50.801136 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:50.801092    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:19:51.783682 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:51.782436    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:48096->10.133.0.76:15021: read: connection reset by peer" start-of-body=
Jul 31 22:19:51.783682 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:51.782522    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:48096->10.133.0.76:15021: read: connection reset by peer"
Jul 31 22:19:52.790346 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.790312    2568 generic.go:356] "Generic (PLEG): container finished" podID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerID="638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a" exitCode=0
Jul 31 22:19:52.790742 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.790353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerDied","Data":"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"}
Jul 31 22:19:52.790742 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.790732    2568 scope.go:117] "RemoveContainer" containerID="638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"
Jul 31 22:19:52.791717 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.791690    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:52.791846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.791770    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:52.791846 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:52.791833    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:19:53.798832 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:53.798776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerStarted","Data":"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"}
Jul 31 22:19:54.601358 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:54.601319    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:54.601560 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:54.601483    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 31 22:19:54.601560 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:54.601541    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 31 22:19:55.601554 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:55.601516    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 31 22:19:55.601994 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:55.601588    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 31 22:19:56.601245 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:56.601210    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 31 22:19:56.601417 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:56.601283    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 31 22:19:57.601372 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:57.601336    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 31 22:19:57.601748 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:57.601391    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 31 22:19:58.601094 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:58.601060    2568 patch_prober.go:28] interesting pod/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 31 22:19:58.601250 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:58.601113    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 31 22:19:59.605438 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:59.605396    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:59.605880 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:59.605830    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:19:59.606595 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:19:59.606565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:20:02.682184 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:02.682143    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:05.613911 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.613879    2568 scope.go:117] "RemoveContainer" containerID="3140ee3558bf7380a00a6f72024f9fe964e995396c13dfcc4fdb994ed7fc415c"
Jul 31 22:20:05.692551 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.692522    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"]
Jul 31 22:20:05.692988 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.692972    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:20:05.693045 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.692989    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="996ba0e6-fdb3-4548-9f54-e38a146c4cb9" containerName="istio-proxy"
Jul 31 22:20:05.697496 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.697480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:05.699695 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.699675    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:20:05.704176 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.704100    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"]
Jul 31 22:20:05.789035 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.789010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz\" (UID: \"0ddad992-821a-477b-a01c-35082fe830f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:05.890507 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.890446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz\" (UID: \"0ddad992-821a-477b-a01c-35082fe830f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:05.891042 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:05.891023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz\" (UID: \"0ddad992-821a-477b-a01c-35082fe830f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:06.010916 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:06.010885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:06.145498 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:06.145471    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"]
Jul 31 22:20:06.146574 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:20:06.146551    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddad992_821a_477b_a01c_35082fe830f7.slice/crio-74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18 WatchSource:0}: Error finding container 74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18: Status 404 returned error can't find the container with id 74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18
Jul 31 22:20:06.875404 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:06.875367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz" event={"ID":"0ddad992-821a-477b-a01c-35082fe830f7","Type":"ContainerStarted","Data":"56bb37121836e045ef835d05e81652d9b57a5c865c46ff18dc342618a77b0a2f"}
Jul 31 22:20:06.875771 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:06.875461    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz" event={"ID":"0ddad992-821a-477b-a01c-35082fe830f7","Type":"ContainerStarted","Data":"74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18"}
Jul 31 22:20:06.889693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:06.889264    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz" podStartSLOduration=1.889242353 podStartE2EDuration="1.889242353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:20:06.889093814 +0000 UTC m=+2642.677427390" watchObservedRunningTime="2026-07-31 22:20:06.889242353 +0000 UTC m=+2642.677575926"
Jul 31 22:20:07.882499 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:07.882466    2568 generic.go:356] "Generic (PLEG): container finished" podID="0ddad992-821a-477b-a01c-35082fe830f7" containerID="56bb37121836e045ef835d05e81652d9b57a5c865c46ff18dc342618a77b0a2f" exitCode=0
Jul 31 22:20:07.882894 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:07.882522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz" event={"ID":"0ddad992-821a-477b-a01c-35082fe830f7","Type":"ContainerDied","Data":"56bb37121836e045ef835d05e81652d9b57a5c865c46ff18dc342618a77b0a2f"}
Jul 31 22:20:09.025778 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.025754    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:09.118704 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.118664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca\") pod \"0ddad992-821a-477b-a01c-35082fe830f7\" (UID: \"0ddad992-821a-477b-a01c-35082fe830f7\") "
Jul 31 22:20:09.119048 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.119025    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ddad992-821a-477b-a01c-35082fe830f7" (UID: "0ddad992-821a-477b-a01c-35082fe830f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:20:09.219734 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.219665    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddad992-821a-477b-a01c-35082fe830f7-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:09.897386 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.897354    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"
Jul 31 22:20:09.897569 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.897346    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz" event={"ID":"0ddad992-821a-477b-a01c-35082fe830f7","Type":"ContainerDied","Data":"74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18"}
Jul 31 22:20:09.897569 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:09.897486    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74baf23e3d6b4f0f2df16038678368e09a83ae53d57bbf46e8dcce7579262f18"
Jul 31 22:20:21.137944 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.137908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:21.216790 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.216757    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:21.275117 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.275082    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:21.331917 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.331883    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"]
Jul 31 22:20:21.334471 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.334448    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-ef8f59-4wsgz"]
Jul 31 22:20:21.336630 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.336609    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:21.722357 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:21.722314    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:22.757837 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:22.757786    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddad992-821a-477b-a01c-35082fe830f7" path="/var/lib/kubelet/pods/0ddad992-821a-477b-a01c-35082fe830f7/volumes"
Jul 31 22:20:27.517840 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:27.517771    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:27.572461 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:27.572426    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:27.865098 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:27.865019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:28.019164 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.019124    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:28.136694 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.136622    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"]
Jul 31 22:20:28.137125 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.137108    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddad992-821a-477b-a01c-35082fe830f7" containerName="revoke-keys"
Jul 31 22:20:28.137176 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.137127    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddad992-821a-477b-a01c-35082fe830f7" containerName="revoke-keys"
Jul 31 22:20:28.137214 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.137202    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddad992-821a-477b-a01c-35082fe830f7" containerName="revoke-keys"
Jul 31 22:20:28.140473 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.140457    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:28.142552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.142532    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:20:28.147542 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.147521    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"]
Jul 31 22:20:28.189799 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.189770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv\" (UID: \"d2815b9c-356b-47da-a472-bfafe83eaa39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:28.291126 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.291102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv\" (UID: \"d2815b9c-356b-47da-a472-bfafe83eaa39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:28.291698 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.291678    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv\" (UID: \"d2815b9c-356b-47da-a472-bfafe83eaa39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:28.452270 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.452212    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:28.796734 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:28.796693    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"]
Jul 31 22:20:28.798653 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:20:28.798628    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2815b9c_356b_47da_a472_bfafe83eaa39.slice/crio-ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56 WatchSource:0}: Error finding container ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56: Status 404 returned error can't find the container with id ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56
Jul 31 22:20:29.013188 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:29.013155    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv" event={"ID":"d2815b9c-356b-47da-a472-bfafe83eaa39","Type":"ContainerStarted","Data":"8ee393b799ebca13dced98b39e954a9021c6e0e0ab9e15d4a2da4ea0c3d5586b"}
Jul 31 22:20:29.013288 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:29.013218    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv" event={"ID":"d2815b9c-356b-47da-a472-bfafe83eaa39","Type":"ContainerStarted","Data":"ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56"}
Jul 31 22:20:29.029838 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:29.029776    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv" podStartSLOduration=1.029760027 podStartE2EDuration="1.029760027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:20:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:20:29.026612125 +0000 UTC m=+2664.814945699" watchObservedRunningTime="2026-07-31 22:20:29.029760027 +0000 UTC m=+2664.818093600"
Jul 31 22:20:30.021306 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:30.021273    2568 generic.go:356] "Generic (PLEG): container finished" podID="d2815b9c-356b-47da-a472-bfafe83eaa39" containerID="8ee393b799ebca13dced98b39e954a9021c6e0e0ab9e15d4a2da4ea0c3d5586b" exitCode=0
Jul 31 22:20:30.021692 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:30.021367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv" event={"ID":"d2815b9c-356b-47da-a472-bfafe83eaa39","Type":"ContainerDied","Data":"8ee393b799ebca13dced98b39e954a9021c6e0e0ab9e15d4a2da4ea0c3d5586b"}
Jul 31 22:20:31.156827 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:31.156795    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:31.219473 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:31.219445    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca\") pod \"d2815b9c-356b-47da-a472-bfafe83eaa39\" (UID: \"d2815b9c-356b-47da-a472-bfafe83eaa39\") "
Jul 31 22:20:31.219760 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:31.219739    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2815b9c-356b-47da-a472-bfafe83eaa39" (UID: "d2815b9c-356b-47da-a472-bfafe83eaa39"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:20:31.320560 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:31.320489    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2815b9c-356b-47da-a472-bfafe83eaa39-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:32.034436 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:32.034405    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"
Jul 31 22:20:32.034436 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:32.034408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv" event={"ID":"d2815b9c-356b-47da-a472-bfafe83eaa39","Type":"ContainerDied","Data":"ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56"}
Jul 31 22:20:32.034650 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:32.034463    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecdde027bdcb7eb3be165496af993ae6728c702b90c9f018e5bd37a492b3fd56"
Jul 31 22:20:43.611100 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.611045    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:43.693766 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.693728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:43.758495 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.758464    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:43.810405 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.810373    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"]
Jul 31 22:20:43.813545 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.813520    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d193d8-m6wbv"]
Jul 31 22:20:43.828243 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:43.828190    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:44.181318 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:44.181279    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:44.757771 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:44.757736    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2815b9c-356b-47da-a472-bfafe83eaa39" path="/var/lib/kubelet/pods/d2815b9c-356b-47da-a472-bfafe83eaa39/volumes"
Jul 31 22:20:49.813158 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:49.813114    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:49.876370 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:49.876336    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:50.077693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.077605    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:20:50.077933 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.077892    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy" containerID="cri-o://e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a" gracePeriod=30
Jul 31 22:20:50.101401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.101367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:50.331499 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.331402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:50.663466 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.663367    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:50.979713 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:50.979616    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:51.442430 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:51.442399    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:54.133302 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:54.133259    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:54.235016 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:54.234976    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:55.336001 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.335975    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:20:55.421681 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.421602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:55.439450 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439422    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439551 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439466    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439551 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4xq2\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439551 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439526    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439591    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439660    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439723    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439954 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439792    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token\") pod \"90b8715b-34eb-4df4-92e6-a707f75bc08e\" (UID: \"90b8715b-34eb-4df4-92e6-a707f75bc08e\") "
Jul 31 22:20:55.439954 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data" (OuterVolumeSpecName: "istio-data") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:20:55.440086 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.439956    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:20:55.440086 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440043    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:20:55.440195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440012    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:20:55.440252 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440195    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:20:55.440252 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440236    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-data\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.440366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440256    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90b8715b-34eb-4df4-92e6-a707f75bc08e-istiod-ca-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.440366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440265    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-certs\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.440366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.440273    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-workload-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.441681 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.441655    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:20:55.441681 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.441666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2" (OuterVolumeSpecName: "kube-api-access-n4xq2") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "kube-api-access-n4xq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:20:55.441888 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.441777    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:20:55.441941 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.441910    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token" (OuterVolumeSpecName: "istio-token") pod "90b8715b-34eb-4df4-92e6-a707f75bc08e" (UID: "90b8715b-34eb-4df4-92e6-a707f75bc08e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:20:55.540953 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.540926    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-credential-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.540953 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.540952    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-token\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.541116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.540961    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-podinfo\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.541116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.540969    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90b8715b-34eb-4df4-92e6-a707f75bc08e-istio-envoy\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.541116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.540978    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4xq2\" (UniqueName: \"kubernetes.io/projected/90b8715b-34eb-4df4-92e6-a707f75bc08e-kube-api-access-n4xq2\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:20:55.645519 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.645481    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:55.880726 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.880695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:55.981709 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.981681    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:20:55.998864 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.998835    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:20:55.999226 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999213    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2815b9c-356b-47da-a472-bfafe83eaa39" containerName="revoke-keys"
Jul 31 22:20:55.999269 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999227    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2815b9c-356b-47da-a472-bfafe83eaa39" containerName="revoke-keys"
Jul 31 22:20:55.999269 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999252    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:20:55.999269 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999258    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:20:55.999269 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999265    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:20:55.999401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999271    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:20:55.999401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999335    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:20:55.999401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:55.999346    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2815b9c-356b-47da-a472-bfafe83eaa39" containerName="revoke-keys"
Jul 31 22:20:56.002946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.002929    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.005620 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.005598    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-ee9929\""
Jul 31 22:20:56.005736 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.005696    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-ee9929-dockercfg-ggmz5\""
Jul 31 22:20:56.015758 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.015733    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:20:56.145781 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.145701    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.145946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.145864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxjj7\" (UniqueName: \"kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.176389 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.176360    2568 generic.go:356] "Generic (PLEG): container finished" podID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerID="e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a" exitCode=0
Jul 31 22:20:56.176537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.176412    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"
Jul 31 22:20:56.176537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.176450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerDied","Data":"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"}
Jul 31 22:20:56.176537 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.176522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c" event={"ID":"90b8715b-34eb-4df4-92e6-a707f75bc08e","Type":"ContainerDied","Data":"2a09c34783bd706990efee710b778bb4147de5c0949428ca53b723ce70c2a9ec"}
Jul 31 22:20:56.176665 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.176557    2568 scope.go:117] "RemoveContainer" containerID="e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"
Jul 31 22:20:56.186438 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.186422    2568 scope.go:117] "RemoveContainer" containerID="638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"
Jul 31 22:20:56.194630 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.194610    2568 scope.go:117] "RemoveContainer" containerID="e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"
Jul 31 22:20:56.194894 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:20:56.194869    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a\": container with ID starting with e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a not found: ID does not exist" containerID="e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"
Jul 31 22:20:56.194995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.194898    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a"} err="failed to get container status \"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a\": rpc error: code = NotFound desc = could not find container \"e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a\": container with ID starting with e9699026485f4233541be162f4680728076feb2c71fd92167feb56fad0d6886a not found: ID does not exist"
Jul 31 22:20:56.194995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.194918    2568 scope.go:117] "RemoveContainer" containerID="638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"
Jul 31 22:20:56.195194 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:20:56.195173    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a\": container with ID starting with 638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a not found: ID does not exist" containerID="638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"
Jul 31 22:20:56.195359 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.195195    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a"} err="failed to get container status \"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a\": rpc error: code = NotFound desc = could not find container \"638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a\": container with ID starting with 638bd064d722f6aceb0a2d345c7b4e35c65565030e4d67f6001d164063c4608a not found: ID does not exist"
Jul 31 22:20:56.198313 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.198292    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:20:56.202717 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.202698    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d193d8-openshift-default-7f54d5bd8-wj42c"]
Jul 31 22:20:56.247318 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.247297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxjj7\" (UniqueName: \"kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.247412 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.247348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.248038 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.248022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.254884 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.254866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxjj7\" (UniqueName: \"kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7\") pod \"payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.316859 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.316802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:56.658511 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.658482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:20:56.659728 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:20:56.659703    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e97a81_c817_4775_a065_f041b3fb4285.slice/crio-64aecc203b4d496ceb65afcd3489a86f699b14876830c1fb935d39d590e4592e WatchSource:0}: Error finding container 64aecc203b4d496ceb65afcd3489a86f699b14876830c1fb935d39d590e4592e: Status 404 returned error can't find the container with id 64aecc203b4d496ceb65afcd3489a86f699b14876830c1fb935d39d590e4592e
Jul 31 22:20:56.758110 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:56.758074    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" path="/var/lib/kubelet/pods/90b8715b-34eb-4df4-92e6-a707f75bc08e/volumes"
Jul 31 22:20:57.185000 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:57.184961    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" event={"ID":"27e97a81-c817-4775-a065-f041b3fb4285","Type":"ContainerStarted","Data":"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"}
Jul 31 22:20:57.185185 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:57.185015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" event={"ID":"27e97a81-c817-4775-a065-f041b3fb4285","Type":"ContainerStarted","Data":"64aecc203b4d496ceb65afcd3489a86f699b14876830c1fb935d39d590e4592e"}
Jul 31 22:20:57.185185 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:57.185131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:20:57.202659 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:57.202616    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" podStartSLOduration=2.202604515 podStartE2EDuration="2.202604515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:20:57.199925389 +0000 UTC m=+2692.988258964" watchObservedRunningTime="2026-07-31 22:20:57.202604515 +0000 UTC m=+2692.990938087"
Jul 31 22:20:58.107030 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:20:58.106999    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:08.194333 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:08.194275    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:21:19.138149 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:19.138106    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:19.491782 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:19.491716    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:19.938647 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:19.938524    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:20.559691 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:20.559642    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:23.348442 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:23.348407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:23.445060 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:23.445026    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:24.577044 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.577000    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:21:24.577610 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.577590    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b8715b-34eb-4df4-92e6-a707f75bc08e" containerName="istio-proxy"
Jul 31 22:21:24.580974 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.580949    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.584037 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.584014    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g8mcz\""
Jul 31 22:21:24.584171 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.584014    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-21e950-serving-cert\""
Jul 31 22:21:24.588467 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.588434    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:21:24.617931 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.617904    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:24.687803 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.687772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.687997 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.687894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfnx\" (UniqueName: \"kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.688079 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.688044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.782502 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.782474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:24.788610 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.788578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.788727 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.788651    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfnx\" (UniqueName: \"kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.788794 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.788731    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.789466 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.789446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.791057 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.791035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.799593 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.799571    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfnx\" (UniqueName: \"kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx\") pod \"maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:24.895531 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:24.895472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:25.056277 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.056248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:21:25.058829 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:21:25.058785    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332bf6fe_6b6f_456d_a669_b2a458685604.slice/crio-f871efb817b3973edc3a7e0c35ccb3c4a9e1b4f91ae4601eebd4694eff4f4930 WatchSource:0}: Error finding container f871efb817b3973edc3a7e0c35ccb3c4a9e1b4f91ae4601eebd4694eff4f4930: Status 404 returned error can't find the container with id f871efb817b3973edc3a7e0c35ccb3c4a9e1b4f91ae4601eebd4694eff4f4930
Jul 31 22:21:25.060355 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.060335    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:21:25.070982 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.070956    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:25.172013 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.171935    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:25.196942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.196756    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:21:25.201733 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.201715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.204150 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.204131    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-21e950\""
Jul 31 22:21:25.204240 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.204134    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-21e950-dockercfg-xn2hl\""
Jul 31 22:21:25.216923 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.216900    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:21:25.294552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.294481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnclx\" (UniqueName: \"kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.294732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.294643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.354181 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.354150    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" event={"ID":"332bf6fe-6b6f-456d-a669-b2a458685604","Type":"ContainerStarted","Data":"f871efb817b3973edc3a7e0c35ccb3c4a9e1b4f91ae4601eebd4694eff4f4930"}
Jul 31 22:21:25.395309 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.395280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.395443 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.395338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnclx\" (UniqueName: \"kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.395978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.395958    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.402903 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.402884    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnclx\" (UniqueName: \"kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx\") pod \"payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") " pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.513360 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.513339    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:25.649027 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:25.649001    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:21:25.649785 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:21:25.649760    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2952944_7819_4b3c_93f0_f129404bfa37.slice/crio-c40775875cf9f77e1f863122a6a54c0efad5f1b4b63591fae9b183015db18e1b WatchSource:0}: Error finding container c40775875cf9f77e1f863122a6a54c0efad5f1b4b63591fae9b183015db18e1b: Status 404 returned error can't find the container with id c40775875cf9f77e1f863122a6a54c0efad5f1b4b63591fae9b183015db18e1b
Jul 31 22:21:26.362513 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.362476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" event={"ID":"d2952944-7819-4b3c-93f0-f129404bfa37","Type":"ContainerStarted","Data":"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"}
Jul 31 22:21:26.362723 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.362576    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" event={"ID":"d2952944-7819-4b3c-93f0-f129404bfa37","Type":"ContainerStarted","Data":"c40775875cf9f77e1f863122a6a54c0efad5f1b4b63591fae9b183015db18e1b"}
Jul 31 22:21:26.362723 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.362610    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:26.364127 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.364100    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" event={"ID":"332bf6fe-6b6f-456d-a669-b2a458685604","Type":"ContainerStarted","Data":"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"}
Jul 31 22:21:26.364231 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.364153    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:26.379751 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.379702    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" podStartSLOduration=1.379685093 podStartE2EDuration="1.379685093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:21:26.378385614 +0000 UTC m=+2722.166719188" watchObservedRunningTime="2026-07-31 22:21:26.379685093 +0000 UTC m=+2722.168018667"
Jul 31 22:21:26.394304 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:26.394259    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" podStartSLOduration=2.01830596 podStartE2EDuration="2.394242977s" totalImagesPullingTime="375.937017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:21:26.393533139 +0000 UTC m=+2722.181866716" watchObservedRunningTime="2026-07-31 22:21:26.394242977 +0000 UTC m=+2722.182576549"
Jul 31 22:21:32.375659 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:32.375626    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:21:37.372401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:37.372360    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:21:48.311410 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:48.311369    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:21:50.311677 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:21:50.311640    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:22:20.405572 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:22:20.405521    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:22:58.851870 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:22:58.851756    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:23:43.340623 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:23:43.340587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:23:43.405035 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:23:43.405004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:05.689645 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:05.689615    2568 scope.go:117] "RemoveContainer" containerID="5992540b8dbf2a1855b4d1915a40bd1e59f7165debcc15fa31fa0d54ab9111d5"
Jul 31 22:25:05.699037 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:05.699018    2568 scope.go:117] "RemoveContainer" containerID="4abeab232bbacc22e86409393a3eda1180fb9d2474614ca93025b0f37c0f3eaa"
Jul 31 22:25:09.877105 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:09.877074    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:11.635467 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:11.635430    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:25.922693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:25.922646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:26.743521 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:26.743433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:37.240947 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:37.240905    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:25:51.099181 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:25:51.099116    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:26:11.978055 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:26:11.978018    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:26:20.625053 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:26:20.625014    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:27:05.733381 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:27:05.733309    2568 scope.go:117] "RemoveContainer" containerID="8ee393b799ebca13dced98b39e954a9021c6e0e0ab9e15d4a2da4ea0c3d5586b"
Jul 31 22:27:05.742533 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:27:05.742514    2568 scope.go:117] "RemoveContainer" containerID="56bb37121836e045ef835d05e81652d9b57a5c865c46ff18dc342618a77b0a2f"
Jul 31 22:27:30.235196 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:27:30.235160    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:27:31.122232 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:27:31.122192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:27:39.153199 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:27:39.153161    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:28:19.646929 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:28:19.646896    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:28.761149 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:28.761112    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:29.760680 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:29.760650    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:48.742721 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:48.742675    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:49.076258 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:49.076179    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:49.232116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:49.232085    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:51.967120 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:51.967080    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:52.114159 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:52.114128    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:53.026137 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.026103    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:29:53.029913 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.029891    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.032304 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.032284    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-068335-serving-cert\""
Jul 31 22:29:53.042319 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.042291    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:29:53.066115 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.066089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:53.070567 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.070542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjbm\" (UniqueName: \"kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.070696 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.070663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.070778 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.070762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.171427 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.171395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.171591 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.171478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.171591 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.171534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjbm\" (UniqueName: \"kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.171591 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:29:53.171543    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-serving-cert: secret "maas-api-e2e-ipp-a-068335-serving-cert" not found
Jul 31 22:29:53.171723 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:29:53.171629    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls podName:fa9aa35c-81d4-42a5-b2a0-f2be5788276a nodeName:}" failed. No retries permitted until 2026-07-31 22:29:53.671606049 +0000 UTC m=+3229.459939610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls") pod "maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" (UID: "fa9aa35c-81d4-42a5-b2a0-f2be5788276a") : secret "maas-api-e2e-ipp-a-068335-serving-cert" not found
Jul 31 22:29:53.172177 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.172157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.181491 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.181461    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjbm\" (UniqueName: \"kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.237420 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.237398    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:53.587471 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.587433    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:53.676978 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.676942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.680202 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.680173    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-068335-b4564b856-bqtvl\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:53.697757 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.697727    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:29:53.941370 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:53.941287    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:54.076426 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:54.076390    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:29:54.079803 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:29:54.079773    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9aa35c_81d4_42a5_b2a0_f2be5788276a.slice/crio-f8f41e8fa1996a92a9b341d8189900f1df6428650c93bce4bb1455456f51ba29 WatchSource:0}: Error finding container f8f41e8fa1996a92a9b341d8189900f1df6428650c93bce4bb1455456f51ba29: Status 404 returned error can't find the container with id f8f41e8fa1996a92a9b341d8189900f1df6428650c93bce4bb1455456f51ba29
Jul 31 22:29:54.081159 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:54.081142    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:29:54.380545 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:54.380516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" event={"ID":"fa9aa35c-81d4-42a5-b2a0-f2be5788276a","Type":"ContainerStarted","Data":"f8f41e8fa1996a92a9b341d8189900f1df6428650c93bce4bb1455456f51ba29"}
Jul 31 22:29:55.387677 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:55.387635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" event={"ID":"fa9aa35c-81d4-42a5-b2a0-f2be5788276a","Type":"ContainerStarted","Data":"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"}
Jul 31 22:29:55.388069 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:55.387698    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:29:55.421895 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:29:55.421848    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" podStartSLOduration=1.986549529 podStartE2EDuration="2.421834901s" totalImagesPullingTime="435.285372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:55.419640945 +0000 UTC m=+3231.207974515" watchObservedRunningTime="2026-07-31 22:29:55.421834901 +0000 UTC m=+3231.210168474"
Jul 31 22:30:00.143465 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.143384    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"]
Jul 31 22:30:00.147860 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.147839    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"]
Jul 31 22:30:00.148018 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.147997    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"
Jul 31 22:30:00.150113 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.150094    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:30:00.151550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.151535    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"]
Jul 31 22:30:00.151619 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.151579    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"
Jul 31 22:30:00.159364 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.159329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"
Jul 31 22:30:00.163290 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.163263    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"]
Jul 31 22:30:00.170309 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.168498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"]
Jul 31 22:30:00.170309 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.169727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"
Jul 31 22:30:00.181680 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.181655    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"
Jul 31 22:30:00.182338 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.182316    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"]
Jul 31 22:30:00.219342 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.219308    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"
Jul 31 22:30:00.351961 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.351356    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"]
Jul 31 22:30:00.408755 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.408732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"]
Jul 31 22:30:00.410185 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:30:00.410159    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad018f5_1a2d_4da2_9790_043aa93bb982.slice/crio-90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794 WatchSource:0}: Error finding container 90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794: Status 404 returned error can't find the container with id 90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794
Jul 31 22:30:00.417324 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.417296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v" event={"ID":"bad018f5-1a2d-4da2-9790-043aa93bb982","Type":"ContainerStarted","Data":"90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794"}
Jul 31 22:30:00.418784 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.418759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4" event={"ID":"2c51619d-1800-4633-8c9e-8e5eaa8ff278","Type":"ContainerStarted","Data":"1e0a22dd977cd6b1ae7f56f63e4cb3b572275886f9d2dd347578b0666e060731"}
Jul 31 22:30:00.581836 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:00.581799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"]
Jul 31 22:30:00.583805 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:30:00.583784    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5a16f6_474b_4a84_952e_82aab5e3256f.slice/crio-1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290 WatchSource:0}: Error finding container 1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290: Status 404 returned error can't find the container with id 1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290
Jul 31 22:30:01.399083 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.399063    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:30:01.429605 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.429539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4" event={"ID":"2c51619d-1800-4633-8c9e-8e5eaa8ff278","Type":"ContainerStarted","Data":"e4e6af8d8975ba0a7d82041ea49781fb22b0821b5cfec5326abb5b3c11eeb1f4"}
Jul 31 22:30:01.431242 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.431220    2568 generic.go:356] "Generic (PLEG): container finished" podID="bad018f5-1a2d-4da2-9790-043aa93bb982" containerID="ecdc2aa8518defd54828ab862716c9bc66a3159979118793f09f1775fcf89e93" exitCode=0
Jul 31 22:30:01.431369 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.431291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v" event={"ID":"bad018f5-1a2d-4da2-9790-043aa93bb982","Type":"ContainerDied","Data":"ecdc2aa8518defd54828ab862716c9bc66a3159979118793f09f1775fcf89e93"}
Jul 31 22:30:01.433012 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.432977    2568 generic.go:356] "Generic (PLEG): container finished" podID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerID="c584654b9e7b00214f1d6ce53dce6e14750e093899dbd46a99cfb2d334e7c23e" exitCode=7
Jul 31 22:30:01.433093 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.433023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" event={"ID":"6e5a16f6-474b-4a84-952e-82aab5e3256f","Type":"ContainerDied","Data":"c584654b9e7b00214f1d6ce53dce6e14750e093899dbd46a99cfb2d334e7c23e"}
Jul 31 22:30:01.433093 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.433062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" event={"ID":"6e5a16f6-474b-4a84-952e-82aab5e3256f","Type":"ContainerStarted","Data":"1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290"}
Jul 31 22:30:01.433181 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.433148    2568 scope.go:117] "RemoveContainer" containerID="c584654b9e7b00214f1d6ce53dce6e14750e093899dbd46a99cfb2d334e7c23e"
Jul 31 22:30:01.448999 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:01.448949    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4" podStartSLOduration=1.448930494 podStartE2EDuration="1.448930494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:01.446760925 +0000 UTC m=+3237.235094499" watchObservedRunningTime="2026-07-31 22:30:01.448930494 +0000 UTC m=+3237.237264070"
Jul 31 22:30:02.441527 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:02.441495    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" event={"ID":"6e5a16f6-474b-4a84-952e-82aab5e3256f","Type":"ContainerStarted","Data":"a684bf696e13c7e533bbf3f2fe6ca264c978517ade710e281310e99b6016742c"}
Jul 31 22:30:02.443016 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:02.442989    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c51619d-1800-4633-8c9e-8e5eaa8ff278" containerID="e4e6af8d8975ba0a7d82041ea49781fb22b0821b5cfec5326abb5b3c11eeb1f4" exitCode=0
Jul 31 22:30:02.443132 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:02.443064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4" event={"ID":"2c51619d-1800-4633-8c9e-8e5eaa8ff278","Type":"ContainerDied","Data":"e4e6af8d8975ba0a7d82041ea49781fb22b0821b5cfec5326abb5b3c11eeb1f4"}
Jul 31 22:30:02.461223 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:02.460905    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" podStartSLOduration=2.460885954 podStartE2EDuration="2.460885954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:02.459079327 +0000 UTC m=+3238.247412915" watchObservedRunningTime="2026-07-31 22:30:02.460885954 +0000 UTC m=+3238.249219529"
Jul 31 22:30:02.636248 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:02.636223    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"
Jul 31 22:30:03.451540 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.451507    2568 generic.go:356] "Generic (PLEG): container finished" podID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerID="a684bf696e13c7e533bbf3f2fe6ca264c978517ade710e281310e99b6016742c" exitCode=0
Jul 31 22:30:03.451999 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.451603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" event={"ID":"6e5a16f6-474b-4a84-952e-82aab5e3256f","Type":"ContainerDied","Data":"a684bf696e13c7e533bbf3f2fe6ca264c978517ade710e281310e99b6016742c"}
Jul 31 22:30:03.451999 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.451691    2568 scope.go:117] "RemoveContainer" containerID="c584654b9e7b00214f1d6ce53dce6e14750e093899dbd46a99cfb2d334e7c23e"
Jul 31 22:30:03.453249 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.453228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v" event={"ID":"bad018f5-1a2d-4da2-9790-043aa93bb982","Type":"ContainerDied","Data":"90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794"}
Jul 31 22:30:03.453343 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.453251    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"
Jul 31 22:30:03.453343 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.453276    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90b9c014c7f2bcc816602c2c8fef5d04482a659ce505735e7f15d20315e1f794"
Jul 31 22:30:03.591187 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:03.591166    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"
Jul 31 22:30:04.461875 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:04.461850    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4"
Jul 31 22:30:04.462160 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:04.461849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-z2db4" event={"ID":"2c51619d-1800-4633-8c9e-8e5eaa8ff278","Type":"ContainerDied","Data":"1e0a22dd977cd6b1ae7f56f63e4cb3b572275886f9d2dd347578b0666e060731"}
Jul 31 22:30:04.462160 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:04.461975    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e0a22dd977cd6b1ae7f56f63e4cb3b572275886f9d2dd347578b0666e060731"
Jul 31 22:30:04.601395 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:04.601370    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"
Jul 31 22:30:05.470145 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:05.470118    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"
Jul 31 22:30:05.470516 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:05.470116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss" event={"ID":"6e5a16f6-474b-4a84-952e-82aab5e3256f","Type":"ContainerDied","Data":"1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290"}
Jul 31 22:30:05.470516 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:05.470240    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f7a9dc1d8f14f5a97b86dac6ce4b21730f0e53e8bd84e62305e4238fc379290"
Jul 31 22:30:16.921400 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:16.921365    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:17.904979 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.904946    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:30:17.905375 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905362    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad018f5-1a2d-4da2-9790-043aa93bb982" containerName="cleanup"
Jul 31 22:30:17.905375 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905376    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad018f5-1a2d-4da2-9790-043aa93bb982" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905388    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905394    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905415    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c51619d-1800-4633-8c9e-8e5eaa8ff278" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905420    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c51619d-1800-4633-8c9e-8e5eaa8ff278" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905426    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905431    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905490    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905501    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad018f5-1a2d-4da2-9790-043aa93bb982" containerName="cleanup"
Jul 31 22:30:17.905530 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.905510    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c51619d-1800-4633-8c9e-8e5eaa8ff278" containerName="cleanup"
Jul 31 22:30:17.908692 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.908675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.911421 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.911403    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a88a46-openshift-default-dockercfg-v8j4r\""
Jul 31 22:30:17.924981 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.924959    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:30:17.998721 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.998721 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.998942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.998942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.998942 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.999058 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.998970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.999058 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.999018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.999139 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.999069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8ps\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:17.999139 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:17.999097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100162 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8ps\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100496 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100496 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100657 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100724 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100785 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100785 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100742    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100903 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100824    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.100903 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.100850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.101358 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.101333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.103102 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.103072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.103102 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.103075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.108992 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.108968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.109103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.109015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8ps\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps\") pod \"e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") " pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.219588 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.219520    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:18.321529 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.321495    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:18.375591 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.375567    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:30:18.377118 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:30:18.377092    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95803f91_3d21_46ad_84c4_f71c6c9c1f7c.slice/crio-d4d5e678c1489377cab3781b12d47a6f5d41782f5ed00dcabfe3d7a8ff038f21 WatchSource:0}: Error finding container d4d5e678c1489377cab3781b12d47a6f5d41782f5ed00dcabfe3d7a8ff038f21: Status 404 returned error can't find the container with id d4d5e678c1489377cab3781b12d47a6f5d41782f5ed00dcabfe3d7a8ff038f21
Jul 31 22:30:18.379351 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.379317    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:18.379427 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.379381    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:18.379427 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.379409    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:18.552282 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.552241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerStarted","Data":"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"}
Jul 31 22:30:18.552444 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.552307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerStarted","Data":"d4d5e678c1489377cab3781b12d47a6f5d41782f5ed00dcabfe3d7a8ff038f21"}
Jul 31 22:30:18.575309 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:18.575262    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podStartSLOduration=1.575246599 podStartE2EDuration="1.575246599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:18.573009147 +0000 UTC m=+3254.361342733" watchObservedRunningTime="2026-07-31 22:30:18.575246599 +0000 UTC m=+3254.363580172"
Jul 31 22:30:19.219874 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:19.219844    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:19.224694 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:19.224669    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:19.557943 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:19.557922    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:19.558797 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:19.558778    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:20.548372 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:20.548338    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:20.648044 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:20.648007    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:21.639008 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:21.638955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:21.749684 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:21.749650    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:22.171210 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:22.171175    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:22.272441 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:22.272409    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:34.559407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.559374    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:34.559855 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.559435    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:34.649920 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.649892    2568 generic.go:356] "Generic (PLEG): container finished" podID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerID="57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6" exitCode=0
Jul 31 22:30:34.650056 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.649967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerDied","Data":"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"}
Jul 31 22:30:34.650335 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.650313    2568 scope.go:117] "RemoveContainer" containerID="57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"
Jul 31 22:30:34.651447 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.651419    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:34.651521 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.651488    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:34.651561 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:34.651519    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 22:30:35.658201 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:35.658166    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerStarted","Data":"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"}
Jul 31 22:30:36.220710 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:36.220674    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:36.220925 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:36.220899    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:36.221014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:36.220969    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:37.220007 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:37.219975    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:37.220393 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:37.220027    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:38.219982 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:38.219953    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:38.220161 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:38.220005    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:39.220746 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:39.220711    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:39.221168 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:39.220763    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:40.219807 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:40.219777    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 31 22:30:40.219950 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:40.219851    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 31 22:30:41.224022 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:41.223989    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:41.224517 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:41.224382    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:41.225005 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:41.224984    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:30:45.501040 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:45.501004    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:30:55.050271 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:30:55.050234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:02.948810 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:02.948777    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:37.773107 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:37.773011    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:38.085405 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:38.085336    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:38.185361 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:38.185332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:41.465058 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:41.465005    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:41.556974 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:41.556942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:42.657613 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:42.657580    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:42.802367 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:42.802331    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:43.238994 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:43.238964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:43.340684 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:43.340654    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:31:43.425596 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:31:43.425566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:11.588022 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:11.587979    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:12.305850 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.305798    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"]
Jul 31 22:32:12.306366 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.306340    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" containerName="cleanup"
Jul 31 22:32:12.309776 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.309758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:12.311858 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.311807    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:32:12.316791 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.316765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"]
Jul 31 22:32:12.409581 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.409552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r\" (UID: \"1dd4f276-2d28-49d1-b8bb-7100b7422acd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:12.511022 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.510999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r\" (UID: \"1dd4f276-2d28-49d1-b8bb-7100b7422acd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:12.511577 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.511558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r\" (UID: \"1dd4f276-2d28-49d1-b8bb-7100b7422acd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:12.624060 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.624002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:12.761768 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:12.761741    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"]
Jul 31 22:32:12.764201 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:32:12.764172    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd4f276_2d28_49d1_b8bb_7100b7422acd.slice/crio-db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b WatchSource:0}: Error finding container db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b: Status 404 returned error can't find the container with id db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b
Jul 31 22:32:13.248933 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:13.248889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r" event={"ID":"1dd4f276-2d28-49d1-b8bb-7100b7422acd","Type":"ContainerStarted","Data":"b1fb3cb53414a9e92f07c61d41c1bba4116018378d9d0d897c388792b588073f"}
Jul 31 22:32:13.249071 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:13.248955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r" event={"ID":"1dd4f276-2d28-49d1-b8bb-7100b7422acd","Type":"ContainerStarted","Data":"db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b"}
Jul 31 22:32:13.263847 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:13.263790    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r" podStartSLOduration=1.263776201 podStartE2EDuration="1.263776201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:32:13.261314288 +0000 UTC m=+3369.049647859" watchObservedRunningTime="2026-07-31 22:32:13.263776201 +0000 UTC m=+3369.052109772"
Jul 31 22:32:14.261705 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:14.261669    2568 generic.go:356] "Generic (PLEG): container finished" podID="1dd4f276-2d28-49d1-b8bb-7100b7422acd" containerID="b1fb3cb53414a9e92f07c61d41c1bba4116018378d9d0d897c388792b588073f" exitCode=0
Jul 31 22:32:14.262119 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:14.261735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r" event={"ID":"1dd4f276-2d28-49d1-b8bb-7100b7422acd","Type":"ContainerDied","Data":"b1fb3cb53414a9e92f07c61d41c1bba4116018378d9d0d897c388792b588073f"}
Jul 31 22:32:15.401496 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:15.401474    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:15.437745 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:15.437718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca\") pod \"1dd4f276-2d28-49d1-b8bb-7100b7422acd\" (UID: \"1dd4f276-2d28-49d1-b8bb-7100b7422acd\") "
Jul 31 22:32:15.438045 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:15.438026    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dd4f276-2d28-49d1-b8bb-7100b7422acd" (UID: "1dd4f276-2d28-49d1-b8bb-7100b7422acd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:15.538662 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:15.538607    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd4f276-2d28-49d1-b8bb-7100b7422acd-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:32:16.275415 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:16.275380    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r" event={"ID":"1dd4f276-2d28-49d1-b8bb-7100b7422acd","Type":"ContainerDied","Data":"db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b"}
Jul 31 22:32:16.275598 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:16.275438    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db70bc865c15d68efcecc4dd11aebaf7e210f22e5caf73ff0ffeb6706428cb2b"
Jul 31 22:32:16.275598 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:16.275389    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"
Jul 31 22:32:23.227350 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.227291    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:23.299524 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.299486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:23.366721 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.366689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:23.406305 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.406276    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"]
Jul 31 22:32:23.409083 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.409060    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-184ad7-5ft5r"]
Jul 31 22:32:23.431725 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.431668    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:23.768159 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:23.768131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:24.757765 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:24.757730    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd4f276-2d28-49d1-b8bb-7100b7422acd" path="/var/lib/kubelet/pods/1dd4f276-2d28-49d1-b8bb-7100b7422acd/volumes"
Jul 31 22:32:29.634931 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:29.634887    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:29.697858 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:29.697794    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:29.891356 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:29.891282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:30.114214 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:30.114181    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:33.639912 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.639878    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"]
Jul 31 22:32:33.640398 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.640321    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd4f276-2d28-49d1-b8bb-7100b7422acd" containerName="revoke-keys"
Jul 31 22:32:33.640398 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.640333    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd4f276-2d28-49d1-b8bb-7100b7422acd" containerName="revoke-keys"
Jul 31 22:32:33.640486 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.640421    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd4f276-2d28-49d1-b8bb-7100b7422acd" containerName="revoke-keys"
Jul 31 22:32:33.643852 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.643837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:33.646108 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.646086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:32:33.649947 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.649912    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"]
Jul 31 22:32:33.802423 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.802393    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-068335-sldvd\" (UID: \"6b85b8cf-d7c1-46bb-851e-21543b493fe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:33.903805 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.903735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-068335-sldvd\" (UID: \"6b85b8cf-d7c1-46bb-851e-21543b493fe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:33.904379 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.904354    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-068335-sldvd\" (UID: \"6b85b8cf-d7c1-46bb-851e-21543b493fe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:33.956600 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:33.956582    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:34.087844 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:34.087796    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"]
Jul 31 22:32:34.089004 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:32:34.088972    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b85b8cf_d7c1_46bb_851e_21543b493fe8.slice/crio-ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd WatchSource:0}: Error finding container ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd: Status 404 returned error can't find the container with id ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd
Jul 31 22:32:34.387308 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:34.387279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd" event={"ID":"6b85b8cf-d7c1-46bb-851e-21543b493fe8","Type":"ContainerStarted","Data":"d84462c6ee231980965a3901cd2a718eb074c332e2f9037833863e59bc6c18a8"}
Jul 31 22:32:34.387402 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:34.387329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd" event={"ID":"6b85b8cf-d7c1-46bb-851e-21543b493fe8","Type":"ContainerStarted","Data":"ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd"}
Jul 31 22:32:34.404914 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:34.404867    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd" podStartSLOduration=1.404847953 podStartE2EDuration="1.404847953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:32:34.401292157 +0000 UTC m=+3390.189625728" watchObservedRunningTime="2026-07-31 22:32:34.404847953 +0000 UTC m=+3390.193181526"
Jul 31 22:32:35.394664 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:35.394629    2568 generic.go:356] "Generic (PLEG): container finished" podID="6b85b8cf-d7c1-46bb-851e-21543b493fe8" containerID="d84462c6ee231980965a3901cd2a718eb074c332e2f9037833863e59bc6c18a8" exitCode=0
Jul 31 22:32:35.395021 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:35.394716    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd" event={"ID":"6b85b8cf-d7c1-46bb-851e-21543b493fe8","Type":"ContainerDied","Data":"d84462c6ee231980965a3901cd2a718eb074c332e2f9037833863e59bc6c18a8"}
Jul 31 22:32:36.545182 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:36.545155    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:36.627055 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:36.627028    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca\") pod \"6b85b8cf-d7c1-46bb-851e-21543b493fe8\" (UID: \"6b85b8cf-d7c1-46bb-851e-21543b493fe8\") "
Jul 31 22:32:36.627333 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:36.627313    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b85b8cf-d7c1-46bb-851e-21543b493fe8" (UID: "6b85b8cf-d7c1-46bb-851e-21543b493fe8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:36.727844 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:36.727776    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b85b8cf-d7c1-46bb-851e-21543b493fe8-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:32:37.407923 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:37.407894    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"
Jul 31 22:32:37.408072 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:37.407891    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd" event={"ID":"6b85b8cf-d7c1-46bb-851e-21543b493fe8","Type":"ContainerDied","Data":"ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd"}
Jul 31 22:32:37.408072 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:37.408015    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec04621e22ef89110999c6d4cf08c498237df75519fd8e2ea4ca20f3950862cd"
Jul 31 22:32:49.185889 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.185850    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:32:49.186529 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.186076    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" podUID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" containerName="maas-api" containerID="cri-o://3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91" gracePeriod=30
Jul 31 22:32:49.215282 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.215254    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:49.217022 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.216998    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"]
Jul 31 22:32:49.219675 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.219653    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-068335-29758950-m6jss"]
Jul 31 22:32:49.314045 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.314011    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:49.392777 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.392746    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"]
Jul 31 22:32:49.392995 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.392945    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:49.395748 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.395727    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-068335-sldvd"]
Jul 31 22:32:49.463283 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.463257    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:32:49.481566 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.481540    2568 generic.go:356] "Generic (PLEG): container finished" podID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" containerID="3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91" exitCode=0
Jul 31 22:32:49.481680 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.481586    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"
Jul 31 22:32:49.481680 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.481629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" event={"ID":"fa9aa35c-81d4-42a5-b2a0-f2be5788276a","Type":"ContainerDied","Data":"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"}
Jul 31 22:32:49.481759 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.481689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl" event={"ID":"fa9aa35c-81d4-42a5-b2a0-f2be5788276a","Type":"ContainerDied","Data":"f8f41e8fa1996a92a9b341d8189900f1df6428650c93bce4bb1455456f51ba29"}
Jul 31 22:32:49.481759 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.481720    2568 scope.go:117] "RemoveContainer" containerID="3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"
Jul 31 22:32:49.491066 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.491048    2568 scope.go:117] "RemoveContainer" containerID="3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"
Jul 31 22:32:49.491332 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:32:49.491313    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91\": container with ID starting with 3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91 not found: ID does not exist" containerID="3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"
Jul 31 22:32:49.491382 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.491342    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91"} err="failed to get container status \"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91\": rpc error: code = NotFound desc = could not find container \"3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91\": container with ID starting with 3bbc4510cf0c67ff6b6db53a424857bae8dd328ae1f2dff8deba67da80b93f91 not found: ID does not exist"
Jul 31 22:32:49.505327 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.505306    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:49.637869 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.637841    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") pod \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") "
Jul 31 22:32:49.637998 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.637889    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca\") pod \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") "
Jul 31 22:32:49.637998 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.637910    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cjbm\" (UniqueName: \"kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm\") pod \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\" (UID: \"fa9aa35c-81d4-42a5-b2a0-f2be5788276a\") "
Jul 31 22:32:49.638261 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.638224    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa9aa35c-81d4-42a5-b2a0-f2be5788276a" (UID: "fa9aa35c-81d4-42a5-b2a0-f2be5788276a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:49.639972 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.639952    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa9aa35c-81d4-42a5-b2a0-f2be5788276a" (UID: "fa9aa35c-81d4-42a5-b2a0-f2be5788276a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:32:49.640049 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.639990    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm" (OuterVolumeSpecName: "kube-api-access-2cjbm") pod "fa9aa35c-81d4-42a5-b2a0-f2be5788276a" (UID: "fa9aa35c-81d4-42a5-b2a0-f2be5788276a"). InnerVolumeSpecName "kube-api-access-2cjbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:32:49.739422 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.739399    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-maas-api-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:32:49.739422 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.739423    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-openshift-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:32:49.739591 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.739433    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cjbm\" (UniqueName: \"kubernetes.io/projected/fa9aa35c-81d4-42a5-b2a0-f2be5788276a-kube-api-access-2cjbm\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:32:49.783673 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.783646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:32:49.805003 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.804974    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:32:49.807781 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:49.807760    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-068335-b4564b856-bqtvl"]
Jul 31 22:32:50.757763 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:50.757729    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b85b8cf-d7c1-46bb-851e-21543b493fe8" path="/var/lib/kubelet/pods/6b85b8cf-d7c1-46bb-851e-21543b493fe8/volumes"
Jul 31 22:32:50.758139 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:50.758061    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5a16f6-474b-4a84-952e-82aab5e3256f" path="/var/lib/kubelet/pods/6e5a16f6-474b-4a84-952e-82aab5e3256f/volumes"
Jul 31 22:32:50.758399 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:50.758385    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" path="/var/lib/kubelet/pods/fa9aa35c-81d4-42a5-b2a0-f2be5788276a/volumes"
Jul 31 22:32:54.808861 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:32:54.808802    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:31.312166 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:31.312119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:31.998550 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:31.998515    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:37.641224 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:37.641175    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:51.919111 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:51.919060    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:51.981552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:51.981516    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:52.296299 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.296264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:52.535277 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.535234    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:33:52.665189 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665121    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"]
Jul 31 22:33:52.665560 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665547    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b85b8cf-d7c1-46bb-851e-21543b493fe8" containerName="revoke-keys"
Jul 31 22:33:52.665603 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665562    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b85b8cf-d7c1-46bb-851e-21543b493fe8" containerName="revoke-keys"
Jul 31 22:33:52.665603 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665577    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" containerName="maas-api"
Jul 31 22:33:52.665603 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665582    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" containerName="maas-api"
Jul 31 22:33:52.665698 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665665    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b85b8cf-d7c1-46bb-851e-21543b493fe8" containerName="revoke-keys"
Jul 31 22:33:52.665698 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.665674    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9aa35c-81d4-42a5-b2a0-f2be5788276a" containerName="maas-api"
Jul 31 22:33:52.668988 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.668968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:52.671263 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.671245    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:33:52.676009 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.675984    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"]
Jul 31 22:33:52.696503 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.696471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d\" (UID: \"9cae8c33-0ec5-4d20-85b0-aed4c83e9956\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:52.797415 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.797390    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d\" (UID: \"9cae8c33-0ec5-4d20-85b0-aed4c83e9956\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:52.798044 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.798023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d\" (UID: \"9cae8c33-0ec5-4d20-85b0-aed4c83e9956\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:52.982334 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:52.982249    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:53.121933 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:53.121907    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"]
Jul 31 22:33:53.123535 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:33:53.123510    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cae8c33_0ec5_4d20_85b0_aed4c83e9956.slice/crio-dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb WatchSource:0}: Error finding container dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb: Status 404 returned error can't find the container with id dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb
Jul 31 22:33:53.895952 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:53.895921    2568 generic.go:356] "Generic (PLEG): container finished" podID="9cae8c33-0ec5-4d20-85b0-aed4c83e9956" containerID="4aaf0bbd4c72aa747dd1d9a3e1fd80e5d20bd12b2632cb2085a7cfb6cc6da3ec" exitCode=0
Jul 31 22:33:53.896070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:53.895978    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d" event={"ID":"9cae8c33-0ec5-4d20-85b0-aed4c83e9956","Type":"ContainerDied","Data":"4aaf0bbd4c72aa747dd1d9a3e1fd80e5d20bd12b2632cb2085a7cfb6cc6da3ec"}
Jul 31 22:33:53.896070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:53.896020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d" event={"ID":"9cae8c33-0ec5-4d20-85b0-aed4c83e9956","Type":"ContainerStarted","Data":"dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb"}
Jul 31 22:33:55.043071 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.043048    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:55.118426 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.118396    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca\") pod \"9cae8c33-0ec5-4d20-85b0-aed4c83e9956\" (UID: \"9cae8c33-0ec5-4d20-85b0-aed4c83e9956\") "
Jul 31 22:33:55.118722 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.118701    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cae8c33-0ec5-4d20-85b0-aed4c83e9956" (UID: "9cae8c33-0ec5-4d20-85b0-aed4c83e9956"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:33:55.219419 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.219352    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cae8c33-0ec5-4d20-85b0-aed4c83e9956-maas-api-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:33:55.909085 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.909053    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"
Jul 31 22:33:55.909256 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.909091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d" event={"ID":"9cae8c33-0ec5-4d20-85b0-aed4c83e9956","Type":"ContainerDied","Data":"dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb"}
Jul 31 22:33:55.909256 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:33:55.909158    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbc2e753c76571d51199b708921e921b3e11fdc02667023d72da7bb490f3e7bb"
Jul 31 22:34:03.113095 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.113061    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:03.177241 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.177200    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:03.232106 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.232079    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:03.296460 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.296430    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"]
Jul 31 22:34:03.297294 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.297272    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:03.299467 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.299434    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a88a46-94n6d"]
Jul 31 22:34:03.697205 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:03.697170    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:04.757757 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:04.757727    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cae8c33-0ec5-4d20-85b0-aed4c83e9956" path="/var/lib/kubelet/pods/9cae8c33-0ec5-4d20-85b0-aed4c83e9956/volumes"
Jul 31 22:34:09.481133 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.481098    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:09.540913 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.540880    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:09.731741 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.731657    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:34:09.731935 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.731911    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" containerID="cri-o://79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f" gracePeriod=30
Jul 31 22:34:09.744831 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.744795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:09.978020 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:09.977982    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:11.226553 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:11.226517    2568 patch_prober.go:28] interesting pod/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 22:34:11.226960 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:11.226584    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 22:34:14.982014 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:14.981989    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:34:15.030931 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.030843    2568 generic.go:356] "Generic (PLEG): container finished" podID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerID="79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f" exitCode=0
Jul 31 22:34:15.030931 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.030871    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"
Jul 31 22:34:15.030931 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.030902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerDied","Data":"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"}
Jul 31 22:34:15.031172 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.030955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh" event={"ID":"95803f91-3d21-46ad-84c4-f71c6c9c1f7c","Type":"ContainerDied","Data":"d4d5e678c1489377cab3781b12d47a6f5d41782f5ed00dcabfe3d7a8ff038f21"}
Jul 31 22:34:15.031172 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.030978    2568 scope.go:117] "RemoveContainer" containerID="79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"
Jul 31 22:34:15.042588 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.042561    2568 scope.go:117] "RemoveContainer" containerID="57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"
Jul 31 22:34:15.051973 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.051956    2568 scope.go:117] "RemoveContainer" containerID="79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"
Jul 31 22:34:15.052217 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:34:15.052199    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f\": container with ID starting with 79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f not found: ID does not exist" containerID="79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"
Jul 31 22:34:15.052279 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.052227    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f"} err="failed to get container status \"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f\": rpc error: code = NotFound desc = could not find container \"79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f\": container with ID starting with 79db35467ebbad6471ee83d3ab37a6e4687d19f52be0f0d33bd3098bfeee6d9f not found: ID does not exist"
Jul 31 22:34:15.052279 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.052244    2568 scope.go:117] "RemoveContainer" containerID="57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"
Jul 31 22:34:15.052492 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:34:15.052470    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6\": container with ID starting with 57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6 not found: ID does not exist" containerID="57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"
Jul 31 22:34:15.052578 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.052496    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6"} err="failed to get container status \"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6\": rpc error: code = NotFound desc = could not find container \"57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6\": container with ID starting with 57a7304a2edba6e8508e4945a1d862871db10de7365c2a898c26e8f443c903a6 not found: ID does not exist"
Jul 31 22:34:15.106872 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.106853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.106965 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.106879    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.106965 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.106910    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.106965 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.106950    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.106970    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107010    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107043    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107075    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107114    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw8ps\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps\") pod \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\" (UID: \"95803f91-3d21-46ad-84c4-f71c6c9c1f7c\") "
Jul 31 22:34:15.107317 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107142    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:34:15.107419 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:34:15.107419 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107339    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:15.107419 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107361    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:34:15.107544 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107483    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:34:15.107594 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107550    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istiod-ca-cert\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.107594 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107570    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-data\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.107594 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107583    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.107700 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.107596    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-workload-certs\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.109210 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.109180    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:15.109312 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.109238    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:34:15.109568 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.109549    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:34:15.109626 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.109589    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps" (OuterVolumeSpecName: "kube-api-access-rw8ps") pod "95803f91-3d21-46ad-84c4-f71c6c9c1f7c" (UID: "95803f91-3d21-46ad-84c4-f71c6c9c1f7c"). InnerVolumeSpecName "kube-api-access-rw8ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:15.209119 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.209093    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-podinfo\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.209119 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.209116    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-token\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.209262 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.209125    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-credential-socket\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.209262 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.209134    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw8ps\" (UniqueName: \"kubernetes.io/projected/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-kube-api-access-rw8ps\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.209262 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.209143    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95803f91-3d21-46ad-84c4-f71c6c9c1f7c-istio-envoy\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:15.356350 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.356316    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:34:15.359449 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:15.359425    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a88a46-openshift-default-5fbc8548d4-ctjhh"]
Jul 31 22:34:16.757359 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:16.757322    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" path="/var/lib/kubelet/pods/95803f91-3d21-46ad-84c4-f71c6c9c1f7c/volumes"
Jul 31 22:34:20.579664 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.579628    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"]
Jul 31 22:34:20.583181 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.583148    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:20.585419 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.585395    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ee9929-29758950-xtd7v"]
Jul 31 22:34:20.606253 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.606218    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:34:20.606484 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.606458    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" podUID="27e97a81-c817-4775-a065-f041b3fb4285" containerName="payload-processing" containerID="cri-o://0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf" gracePeriod=30
Jul 31 22:34:20.648429 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.648396    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:20.747234 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.747200    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:20.758422 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.758390    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad018f5-1a2d-4da2-9790-043aa93bb982" path="/var/lib/kubelet/pods/bad018f5-1a2d-4da2-9790-043aa93bb982/volumes"
Jul 31 22:34:20.799394 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.799294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:20.862412 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.862389    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:34:20.971107 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.971075    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume\") pod \"27e97a81-c817-4775-a065-f041b3fb4285\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") "
Jul 31 22:34:20.971276 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.971146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxjj7\" (UniqueName: \"kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7\") pod \"27e97a81-c817-4775-a065-f041b3fb4285\" (UID: \"27e97a81-c817-4775-a065-f041b3fb4285\") "
Jul 31 22:34:20.971510 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.971485    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27e97a81-c817-4775-a065-f041b3fb4285" (UID: "27e97a81-c817-4775-a065-f041b3fb4285"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:20.973180 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:20.973152    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7" (OuterVolumeSpecName: "kube-api-access-nxjj7") pod "27e97a81-c817-4775-a065-f041b3fb4285" (UID: "27e97a81-c817-4775-a065-f041b3fb4285"). InnerVolumeSpecName "kube-api-access-nxjj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:21.070939 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.070896    2568 generic.go:356] "Generic (PLEG): container finished" podID="27e97a81-c817-4775-a065-f041b3fb4285" containerID="0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf" exitCode=0
Jul 31 22:34:21.071135 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.070948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" event={"ID":"27e97a81-c817-4775-a065-f041b3fb4285","Type":"ContainerDied","Data":"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"}
Jul 31 22:34:21.071135 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.070963    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"
Jul 31 22:34:21.071135 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.071063    2568 scope.go:117] "RemoveContainer" containerID="0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"
Jul 31 22:34:21.071135 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.071049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679" event={"ID":"27e97a81-c817-4775-a065-f041b3fb4285","Type":"ContainerDied","Data":"64aecc203b4d496ceb65afcd3489a86f699b14876830c1fb935d39d590e4592e"}
Jul 31 22:34:21.072159 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.072136    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27e97a81-c817-4775-a065-f041b3fb4285-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:21.072447 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.072304    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxjj7\" (UniqueName: \"kubernetes.io/projected/27e97a81-c817-4775-a065-f041b3fb4285-kube-api-access-nxjj7\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:21.083264 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.083243    2568 scope.go:117] "RemoveContainer" containerID="0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"
Jul 31 22:34:21.083601 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:34:21.083573    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf\": container with ID starting with 0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf not found: ID does not exist" containerID="0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"
Jul 31 22:34:21.083663 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.083614    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf"} err="failed to get container status \"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf\": rpc error: code = NotFound desc = could not find container \"0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf\": container with ID starting with 0040e39220ea4a516483bf3833c5d94e217a505efb79891e58d6ad527998acbf not found: ID does not exist"
Jul 31 22:34:21.094961 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.094885    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:34:21.099984 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.099957    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ee9929-7b7c95f994-s5679"]
Jul 31 22:34:21.226037 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:21.226002    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:22.757809 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:22.757771    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e97a81-c817-4775-a065-f041b3fb4285" path="/var/lib/kubelet/pods/27e97a81-c817-4775-a065-f041b3fb4285/volumes"
Jul 31 22:34:27.022242 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:27.022159    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:27.120395 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:27.120362    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:27.827028 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:27.826995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:28.130108 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:28.130028    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:38.835028 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.834991    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:34:38.835545 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.835216    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" podUID="332bf6fe-6b6f-456d-a669-b2a458685604" containerName="maas-api" containerID="cri-o://9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772" gracePeriod=30
Jul 31 22:34:38.855241 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.855210    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:38.881525 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.881499    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:34:38.881709 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.881674    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" podUID="d2952944-7819-4b3c-93f0-f129404bfa37" containerName="payload-processing" containerID="cri-o://f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6" gracePeriod=30
Jul 31 22:34:38.952156 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:38.952129    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:39.029195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.029113    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:39.093416 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.093386    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:39.134510 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.134485    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:34:39.164541 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.164516    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:34:39.184285 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.184257    2568 generic.go:356] "Generic (PLEG): container finished" podID="332bf6fe-6b6f-456d-a669-b2a458685604" containerID="9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772" exitCode=0
Jul 31 22:34:39.184409 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.184296    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"
Jul 31 22:34:39.184409 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.184330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" event={"ID":"332bf6fe-6b6f-456d-a669-b2a458685604","Type":"ContainerDied","Data":"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"}
Jul 31 22:34:39.184409 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.184375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6" event={"ID":"332bf6fe-6b6f-456d-a669-b2a458685604","Type":"ContainerDied","Data":"f871efb817b3973edc3a7e0c35ccb3c4a9e1b4f91ae4601eebd4694eff4f4930"}
Jul 31 22:34:39.184409 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.184398    2568 scope.go:117] "RemoveContainer" containerID="9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"
Jul 31 22:34:39.186047 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.186021    2568 generic.go:356] "Generic (PLEG): container finished" podID="d2952944-7819-4b3c-93f0-f129404bfa37" containerID="f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6" exitCode=0
Jul 31 22:34:39.186170 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.186054    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"
Jul 31 22:34:39.186170 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.186094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" event={"ID":"d2952944-7819-4b3c-93f0-f129404bfa37","Type":"ContainerDied","Data":"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"}
Jul 31 22:34:39.186170 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.186143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr" event={"ID":"d2952944-7819-4b3c-93f0-f129404bfa37","Type":"ContainerDied","Data":"c40775875cf9f77e1f863122a6a54c0efad5f1b4b63591fae9b183015db18e1b"}
Jul 31 22:34:39.193941 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.193924    2568 scope.go:117] "RemoveContainer" containerID="9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"
Jul 31 22:34:39.194184 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:34:39.194167    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772\": container with ID starting with 9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772 not found: ID does not exist" containerID="9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"
Jul 31 22:34:39.194237 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.194192    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772"} err="failed to get container status \"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772\": rpc error: code = NotFound desc = could not find container \"9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772\": container with ID starting with 9a0b0534d1e984666d07ca86ac43f657aa547f81699600bcd8091b384dc4d772 not found: ID does not exist"
Jul 31 22:34:39.194237 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.194209    2568 scope.go:117] "RemoveContainer" containerID="f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"
Jul 31 22:34:39.203708 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.203691    2568 scope.go:117] "RemoveContainer" containerID="f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"
Jul 31 22:34:39.204017 ip-10-0-134-210 kubenswrapper[2568]: E0731 22:34:39.203987    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6\": container with ID starting with f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6 not found: ID does not exist" containerID="f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"
Jul 31 22:34:39.204108 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.204016    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6"} err="failed to get container status \"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6\": rpc error: code = NotFound desc = could not find container \"f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6\": container with ID starting with f585abaecf0987c1634e65d1a94d70582c7baf3f0edd323a5526b8062b36a4f6 not found: ID does not exist"
Jul 31 22:34:39.226082 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226063    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnclx\" (UniqueName: \"kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx\") pod \"d2952944-7819-4b3c-93f0-f129404bfa37\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") "
Jul 31 22:34:39.226082 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226091    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls\") pod \"332bf6fe-6b6f-456d-a669-b2a458685604\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") "
Jul 31 22:34:39.226247 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226119    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume\") pod \"d2952944-7819-4b3c-93f0-f129404bfa37\" (UID: \"d2952944-7819-4b3c-93f0-f129404bfa37\") "
Jul 31 22:34:39.226247 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca\") pod \"332bf6fe-6b6f-456d-a669-b2a458685604\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") "
Jul 31 22:34:39.226247 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226230    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnfnx\" (UniqueName: \"kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx\") pod \"332bf6fe-6b6f-456d-a669-b2a458685604\" (UID: \"332bf6fe-6b6f-456d-a669-b2a458685604\") "
Jul 31 22:34:39.226596 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226559    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "332bf6fe-6b6f-456d-a669-b2a458685604" (UID: "332bf6fe-6b6f-456d-a669-b2a458685604"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:39.226596 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.226561    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2952944-7819-4b3c-93f0-f129404bfa37" (UID: "d2952944-7819-4b3c-93f0-f129404bfa37"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:39.228091 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.228072    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx" (OuterVolumeSpecName: "kube-api-access-jnclx") pod "d2952944-7819-4b3c-93f0-f129404bfa37" (UID: "d2952944-7819-4b3c-93f0-f129404bfa37"). InnerVolumeSpecName "kube-api-access-jnclx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:39.228271 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.228256    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx" (OuterVolumeSpecName: "kube-api-access-jnfnx") pod "332bf6fe-6b6f-456d-a669-b2a458685604" (UID: "332bf6fe-6b6f-456d-a669-b2a458685604"). InnerVolumeSpecName "kube-api-access-jnfnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:39.228518 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.228505    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "332bf6fe-6b6f-456d-a669-b2a458685604" (UID: "332bf6fe-6b6f-456d-a669-b2a458685604"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:34:39.326889 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.326869    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnfnx\" (UniqueName: \"kubernetes.io/projected/332bf6fe-6b6f-456d-a669-b2a458685604-kube-api-access-jnfnx\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:39.326889 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.326889    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnclx\" (UniqueName: \"kubernetes.io/projected/d2952944-7819-4b3c-93f0-f129404bfa37-kube-api-access-jnclx\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:39.327000 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.326898    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/332bf6fe-6b6f-456d-a669-b2a458685604-maas-api-tls\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:39.327000 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.326907    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2952944-7819-4b3c-93f0-f129404bfa37-plugins-config-volume\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:39.327000 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.326916    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/332bf6fe-6b6f-456d-a669-b2a458685604-openshift-service-ca\") on node \"ip-10-0-134-210.ec2.internal\" DevicePath \"\""
Jul 31 22:34:39.392910 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.392849    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:39.513631 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.513610    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:34:39.519673 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.519650    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-21e950-5789cf64c4-vrrh6"]
Jul 31 22:34:39.528857 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.528832    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:34:39.533616 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:39.533596    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-21e950-55d7868b54-6hxgr"]
Jul 31 22:34:40.757109 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:40.757077    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332bf6fe-6b6f-456d-a669-b2a458685604" path="/var/lib/kubelet/pods/332bf6fe-6b6f-456d-a669-b2a458685604/volumes"
Jul 31 22:34:40.757539 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:40.757432    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2952944-7819-4b3c-93f0-f129404bfa37" path="/var/lib/kubelet/pods/d2952944-7819-4b3c-93f0-f129404bfa37/volumes"
Jul 31 22:34:45.172567 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:45.172529    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:45.272852 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:45.272795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:45.423877 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:45.423768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:45.656343 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:45.656305    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:34:51.772389 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:51.772360    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r92nb_7744d428-f259-4637-98c2-0986d2525009/server/0.log"
Jul 31 22:34:51.894177 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:51.894137    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tgtdz_4c4fd200-f8bd-49fc-b918-6249a7e610e4/manager/0.log"
Jul 31 22:34:52.160683 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:52.160604    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-lhvmb_5aa927cc-ad82-4db4-9ff8-fb6a71af508d/copy-manifests/0.log"
Jul 31 22:34:52.168232 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:52.168202    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-lhvmb_5aa927cc-ad82-4db4-9ff8-fb6a71af508d/manager/0.log"
Jul 31 22:34:52.795887 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:52.795856    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758920-kvmq9_f6b5edb3-652f-4b3c-9001-7027d8caa1a5/cleanup/0.log"
Jul 31 22:34:52.906529 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:52.906493    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758935-67hrp_16393f8f-5634-498e-9ac6-c78a0bd4371e/cleanup/0.log"
Jul 31 22:34:53.019121 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:53.019090    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758950-z2db4_2c51619d-1800-4633-8c9e-8e5eaa8ff278/cleanup/0.log"
Jul 31 22:34:53.134566 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:53.134471    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ps7gn_5c779840-5c45-4771-bd33-a5c498582e02/postgres/0.log"
Jul 31 22:34:54.271758 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:54.271727    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zt9b2_8d8a1234-c6e7-4c18-b4b9-c1567f9ae000/kuadrant-console-plugin/0.log"
Jul 31 22:34:54.389134 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:54.389106    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-pklh8_db671b35-2b37-4044-91ac-ecf701849392/manager/0.log"
Jul 31 22:34:54.980197 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:54.980164    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2_e75ce6e6-7f07-44b5-8a69-6fa810f260a3/istio-proxy/0.log"
Jul 31 22:34:55.106469 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:55.106436    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bprp5_5457c8cf-032d-4200-92ea-c60d8238140f/discovery/0.log"
Jul 31 22:34:55.340268 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:55.340234    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64667dffd7-vz949_c6a2f468-fdd6-4fa7-83ca-89c032bf7073/kube-auth-proxy/0.log"
Jul 31 22:34:55.458613 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:55.458580    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/1.log"
Jul 31 22:34:55.828384 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:55.828356    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58c9c7d678-8j8t8_d1475c67-dcf8-4a7d-bc10-73508e1ea642/router/0.log"
Jul 31 22:34:56.411121 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:56.411087    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-q9ddv_a3799080-3dbb-45bc-8740-aef336838174/main/0.log"
Jul 31 22:34:56.646218 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:34:56.646193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cmsvf_97342bc6-344a-4105-b578-0e78626a16c5/main/0.log"
Jul 31 22:35:02.538714 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:02.538635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:35:02.593316 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:02.593282    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log" limit=1024
Jul 31 22:35:05.841964 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:05.841927    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xm2fg_0277b2e7-fe6e-427a-a3e5-99f8e813049b/global-pull-secret-syncer/0.log"
Jul 31 22:35:05.887604 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:05.887577    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7gn7f_80112fed-0ee5-429d-99cf-394966dfb15c/konnectivity-agent/0.log"
Jul 31 22:35:05.994401 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:05.994378    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-210.ec2.internal_4933a03e6e601d67493ba375e1a2d98a/haproxy/0.log"
Jul 31 22:35:11.448259 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:11.448226    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zt9b2_8d8a1234-c6e7-4c18-b4b9-c1567f9ae000/kuadrant-console-plugin/0.log"
Jul 31 22:35:11.546843 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:11.546783    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-pklh8_db671b35-2b37-4044-91ac-ecf701849392/manager/0.log"
Jul 31 22:35:13.188972 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.188943    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/alertmanager/0.log"
Jul 31 22:35:13.210799 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.210771    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/config-reloader/0.log"
Jul 31 22:35:13.232245 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.232216    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/kube-rbac-proxy-web/0.log"
Jul 31 22:35:13.256420 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.256377    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/kube-rbac-proxy/0.log"
Jul 31 22:35:13.278468 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.278436    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/kube-rbac-proxy-metric/0.log"
Jul 31 22:35:13.299626 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.299595    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/prom-label-proxy/0.log"
Jul 31 22:35:13.320803 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.320780    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_785e0a25-c430-45d2-b4ac-f9568ac20dcc/init-config-reloader/0.log"
Jul 31 22:35:13.415573 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.415545    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-2p4tv_838d3474-4afb-4505-8a51-9659acfeb9fe/kube-state-metrics/0.log"
Jul 31 22:35:13.434693 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.434651    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-2p4tv_838d3474-4afb-4505-8a51-9659acfeb9fe/kube-rbac-proxy-main/0.log"
Jul 31 22:35:13.457554 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.457478    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-2p4tv_838d3474-4afb-4505-8a51-9659acfeb9fe/kube-rbac-proxy-self/0.log"
Jul 31 22:35:13.623716 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.623693    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k24mh_a24c53a6-cad4-4f80-a837-74b6cf2eea39/node-exporter/0.log"
Jul 31 22:35:13.643499 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.643475    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k24mh_a24c53a6-cad4-4f80-a837-74b6cf2eea39/kube-rbac-proxy/0.log"
Jul 31 22:35:13.664250 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.664231    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k24mh_a24c53a6-cad4-4f80-a837-74b6cf2eea39/init-textfile/0.log"
Jul 31 22:35:13.984345 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:13.984313    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-cz7mq_1e25aa26-1c3e-4c68-b0f1-b85df982ac5f/prometheus-operator/0.log"
Jul 31 22:35:14.001213 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.001178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-cz7mq_1e25aa26-1c3e-4c68-b0f1-b85df982ac5f/kube-rbac-proxy/0.log"
Jul 31 22:35:14.023453 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.023420    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-xpfst_5d9e74fa-ced1-42d7-a3e3-5b4250346fba/prometheus-operator-admission-webhook/0.log"
Jul 31 22:35:14.048654 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.048622    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74797748c-g578j_073ba452-b682-47da-be77-2f6adb8b7ad3/telemeter-client/0.log"
Jul 31 22:35:14.068344 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.068306    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74797748c-g578j_073ba452-b682-47da-be77-2f6adb8b7ad3/reload/0.log"
Jul 31 22:35:14.088376 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.088336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74797748c-g578j_073ba452-b682-47da-be77-2f6adb8b7ad3/kube-rbac-proxy/0.log"
Jul 31 22:35:14.114639 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.114609    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/thanos-query/0.log"
Jul 31 22:35:14.134766 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.134738    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/kube-rbac-proxy-web/0.log"
Jul 31 22:35:14.161547 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.161516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/kube-rbac-proxy/0.log"
Jul 31 22:35:14.184461 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.184433    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/prom-label-proxy/0.log"
Jul 31 22:35:14.206623 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.206596    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/kube-rbac-proxy-rules/0.log"
Jul 31 22:35:14.231103 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:14.231070    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-858697878d-fg4sr_fceb4fc1-0547-48b1-8890-975d48ac8cc8/kube-rbac-proxy-metrics/0.log"
Jul 31 22:35:15.445684 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.445653    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"]
Jul 31 22:35:15.446116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446102    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy"
Jul 31 22:35:15.446116 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446117    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446137    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cae8c33-0ec5-4d20-85b0-aed4c83e9956" containerName="revoke-keys"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446144    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cae8c33-0ec5-4d20-85b0-aed4c83e9956" containerName="revoke-keys"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446153    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e97a81-c817-4775-a065-f041b3fb4285" containerName="payload-processing"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446159    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e97a81-c817-4775-a065-f041b3fb4285" containerName="payload-processing"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446167    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332bf6fe-6b6f-456d-a669-b2a458685604" containerName="maas-api"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446172    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="332bf6fe-6b6f-456d-a669-b2a458685604" containerName="maas-api"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446178    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2952944-7819-4b3c-93f0-f129404bfa37" containerName="payload-processing"
Jul 31 22:35:15.446195 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446182    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2952944-7819-4b3c-93f0-f129404bfa37" containerName="payload-processing"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446247    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e97a81-c817-4775-a065-f041b3fb4285" containerName="payload-processing"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446254    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cae8c33-0ec5-4d20-85b0-aed4c83e9956" containerName="revoke-keys"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446264    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="332bf6fe-6b6f-456d-a669-b2a458685604" containerName="maas-api"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446272    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2952944-7819-4b3c-93f0-f129404bfa37" containerName="payload-processing"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446278    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy"
Jul 31 22:35:15.446448 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.446284    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="95803f91-3d21-46ad-84c4-f71c6c9c1f7c" containerName="istio-proxy"
Jul 31 22:35:15.449532 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.449517    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.451519 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.451499    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pm8cl\"/\"default-dockercfg-cz62l\""
Jul 31 22:35:15.451716 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.451554    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pm8cl\"/\"openshift-service-ca.crt\""
Jul 31 22:35:15.452148 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.452125    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pm8cl\"/\"kube-root-ca.crt\""
Jul 31 22:35:15.458386 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.458356    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"]
Jul 31 22:35:15.554142 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.554115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-sys\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.554291 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.554170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcd8m\" (UniqueName: \"kubernetes.io/projected/952a13e0-46af-4a08-996c-3fb925979bdb-kube-api-access-gcd8m\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.554291 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.554198    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-lib-modules\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.554291 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.554278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-podres\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.554407 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.554310    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-proc\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655051 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-sys\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655225 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcd8m\" (UniqueName: \"kubernetes.io/projected/952a13e0-46af-4a08-996c-3fb925979bdb-kube-api-access-gcd8m\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655225 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-lib-modules\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655225 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-sys\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655225 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-podres\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655225 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-proc\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-podres\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655284    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-proc\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.655454 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.655285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/952a13e0-46af-4a08-996c-3fb925979bdb-lib-modules\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.662496 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.662474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcd8m\" (UniqueName: \"kubernetes.io/projected/952a13e0-46af-4a08-996c-3fb925979bdb-kube-api-access-gcd8m\") pod \"perf-node-gather-daemonset-8bf4g\" (UID: \"952a13e0-46af-4a08-996c-3fb925979bdb\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.760697 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.760675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:15.905306 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:15.905280    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"]
Jul 31 22:35:15.907008 ip-10-0-134-210 kubenswrapper[2568]: W0731 22:35:15.906976    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod952a13e0_46af_4a08_996c_3fb925979bdb.slice/crio-9cc610031a892338a9b54b3043944b8012b6ef49b71544caa2c3f12e781f4ab1 WatchSource:0}: Error finding container 9cc610031a892338a9b54b3043944b8012b6ef49b71544caa2c3f12e781f4ab1: Status 404 returned error can't find the container with id 9cc610031a892338a9b54b3043944b8012b6ef49b71544caa2c3f12e781f4ab1
Jul 31 22:35:16.415039 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.415000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g" event={"ID":"952a13e0-46af-4a08-996c-3fb925979bdb","Type":"ContainerStarted","Data":"6c946ab5afb3a4161b99d10b09cbf6c36b5fa4370882d082ce246a1120eafb41"}
Jul 31 22:35:16.415236 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.415070    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:16.415236 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.415097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g" event={"ID":"952a13e0-46af-4a08-996c-3fb925979bdb","Type":"ContainerStarted","Data":"9cc610031a892338a9b54b3043944b8012b6ef49b71544caa2c3f12e781f4ab1"}
Jul 31 22:35:16.428985 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.428933    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g" podStartSLOduration=1.428913992 podStartE2EDuration="1.428913992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:16.428201456 +0000 UTC m=+3552.216535029" watchObservedRunningTime="2026-07-31 22:35:16.428913992 +0000 UTC m=+3552.217247569"
Jul 31 22:35:16.435695 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.435672    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6dfc69bc-492sb_22caa7a0-02ba-4b8e-ae81-5005ec6276ec/console/0.log"
Jul 31 22:35:16.467681 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:16.467661    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-rwb5n_2d0238b0-cf1f-47a8-bc74-98f05d9ab01e/download-server/0.log"
Jul 31 22:35:17.097552 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:17.097522    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-pxfgf_d97746e5-f26f-4c90-9bd4-7f894372613a/volume-data-source-validator/0.log"
Jul 31 22:35:18.061260 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:18.061227    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-499cx_b408572c-5e22-409f-b46f-d1dea8aa98c1/dns/0.log"
Jul 31 22:35:18.080680 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:18.080627    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-499cx_b408572c-5e22-409f-b46f-d1dea8aa98c1/kube-rbac-proxy/0.log"
Jul 31 22:35:18.207727 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:18.207689    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k25gn_ac169c71-cf00-4dd4-b909-28a42d6132cb/dns-node-resolver/0.log"
Jul 31 22:35:18.725946 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:18.725912    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bc8d6c5c5-5jw8x_864b0c52-921b-4e23-94af-f957667f5a65/registry/0.log"
Jul 31 22:35:18.745343 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:18.745308    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h64xh_7b75f95f-6347-477e-acae-4bcbd156b602/node-ca/0.log"
Jul 31 22:35:19.675732 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:19.675688    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2_e75ce6e6-7f07-44b5-8a69-6fa810f260a3/istio-proxy/0.log"
Jul 31 22:35:19.854657 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:19.854628    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bprp5_5457c8cf-032d-4200-92ea-c60d8238140f/discovery/0.log"
Jul 31 22:35:19.894700 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:19.894671    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64667dffd7-vz949_c6a2f468-fdd6-4fa7-83ca-89c032bf7073/kube-auth-proxy/0.log"
Jul 31 22:35:19.920413 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:19.920368    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/0.log"
Jul 31 22:35:19.926882 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:19.926804    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/1.log"
Jul 31 22:35:20.032070 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:20.032018    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58c9c7d678-8j8t8_d1475c67-dcf8-4a7d-bc10-73508e1ea642/router/0.log"
Jul 31 22:35:20.812189 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:20.812156    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mfnb_da36a2fc-6c1b-41ec-b02f-2dbd028cc2ed/serve-healthcheck-canary/0.log"
Jul 31 22:35:21.307828 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:21.307793    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-gqxf9_d539e0ff-ebd8-458e-9c80-4f2ab502ae14/insights-operator/0.log"
Jul 31 22:35:21.308349 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:21.308333    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-gqxf9_d539e0ff-ebd8-458e-9c80-4f2ab502ae14/insights-operator/1.log"
Jul 31 22:35:21.450107 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:21.450084    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vw6jd_b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945/kube-rbac-proxy/0.log"
Jul 31 22:35:21.468622 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:21.468602    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vw6jd_b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945/exporter/0.log"
Jul 31 22:35:21.490024 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:21.490007    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vw6jd_b48e8d8d-56dc-4ddf-8c5b-97bca3fd8945/extractor/0.log"
Jul 31 22:35:22.430555 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:22.430525    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-8bf4g"
Jul 31 22:35:24.115728 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:24.115694    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r92nb_7744d428-f259-4637-98c2-0986d2525009/server/0.log"
Jul 31 22:35:24.187353 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:24.187328    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tgtdz_4c4fd200-f8bd-49fc-b918-6249a7e610e4/manager/0.log"
Jul 31 22:35:24.393079 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:24.393052    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-lhvmb_5aa927cc-ad82-4db4-9ff8-fb6a71af508d/manager/0.log"
Jul 31 22:35:24.415185 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:24.415165    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-lhvmb_5aa927cc-ad82-4db4-9ff8-fb6a71af508d/copy-manifests/0.log"
Jul 31 22:35:25.452729 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.452661    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2_e75ce6e6-7f07-44b5-8a69-6fa810f260a3/istio-proxy/0.log"
Jul 31 22:35:25.610085 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.610060    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bprp5_5457c8cf-032d-4200-92ea-c60d8238140f/discovery/0.log"
Jul 31 22:35:25.633919 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.633896    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64667dffd7-vz949_c6a2f468-fdd6-4fa7-83ca-89c032bf7073/kube-auth-proxy/0.log"
Jul 31 22:35:25.651752 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.651729    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/0.log"
Jul 31 22:35:25.658433 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.658411    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/1.log"
Jul 31 22:35:25.727582 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:25.727534    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58c9c7d678-8j8t8_d1475c67-dcf8-4a7d-bc10-73508e1ea642/router/0.log"
Jul 31 22:35:27.136452 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.136425    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjgwl2_e75ce6e6-7f07-44b5-8a69-6fa810f260a3/istio-proxy/0.log"
Jul 31 22:35:27.300584 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.300558    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bprp5_5457c8cf-032d-4200-92ea-c60d8238140f/discovery/0.log"
Jul 31 22:35:27.325984 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.325964    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64667dffd7-vz949_c6a2f468-fdd6-4fa7-83ca-89c032bf7073/kube-auth-proxy/0.log"
Jul 31 22:35:27.345125 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.345103    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/0.log"
Jul 31 22:35:27.351511 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.351496    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-qpl66_c5ef3a95-8cf1-4f12-b52c-410f61fe53f0/istio-proxy/1.log"
Jul 31 22:35:27.428470 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:27.428453    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58c9c7d678-8j8t8_d1475c67-dcf8-4a7d-bc10-73508e1ea642/router/0.log"
Jul 31 22:35:32.080631 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.080592    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/kube-multus-additional-cni-plugins/0.log"
Jul 31 22:35:32.102581 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.102552    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/egress-router-binary-copy/0.log"
Jul 31 22:35:32.122568 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.122542    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/cni-plugins/0.log"
Jul 31 22:35:32.141644 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.141618    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/bond-cni-plugin/0.log"
Jul 31 22:35:32.161283 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.161262    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/routeoverride-cni/0.log"
Jul 31 22:35:32.180921 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.180900    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/whereabouts-cni-bincopy/0.log"
Jul 31 22:35:32.199394 ip-10-0-134-210 kubenswrapper[2568]: I0731 22:35:32.199369    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lqbfb_be7d2f11-4da5-4f06-ad0f-4565081c8906/whereabouts-cni/0.log"